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About This Guide 


This guide describes how to install, upgrade, configure, and manage Novell Cluster Services for 
Novell Open Enterprise Server (OES) 11 Support Pack (SP) 3. It is divided into the following sections: 

+ Chapter 1, “Overview of Novell Cluster Services,” on page 17 

+ Chapter 2, “What's New or Changed for Novell Cluster Services,” on page 29 

¢ Chapter 3, “Planning for a Cluster,” on page 41 

¢ Chapter 4, “Planning for Novell Cluster Services,” on page 47 

+ Chapter 5, “Installing, Configuring, and Repairing Novell Cluster Services,” on page 71 

+ Chapter 6, “Upgrading OES 11 Clusters,” on page 101 

¢ Chapter 7, “Upgrading Clusters from OES 2 SP3 to OES 11 SPx,” on page 105 

¢ Chapter 8, “ Configuring Cluster Policies, Protocols, and Properties,” on page 113 

¢ Chapter 9, “ Managing Clusters,” on page 151 

¢ Chapter 10, “Configuring and Managing Cluster Resources,” on page 193 

+ Chapter 11, “Quick Reference for Clustering Services and Data,” on page 233 


¢ Chapter 12, “Configuring and Managing Cluster Resources for Shared NSS Pools and 
Volumes,” on page 237 


¢ Chapter 13, “Configuring and Managing Cluster Resources for Shared LVM Volume Groups,” on 
page 327 


+ Chapter 14, “Upgrading and Managing Cluster Resources for Linux POSIX Volumes with CSM 
Containers,” on page 399 


¢ Chapter 15, “Configuring Novell Cluster Services in a Virtualization Environment,” on page 421 
+ Chapter 16, “Troubleshooting Novell Cluster Services,” on page 437 

¢ Chapter 17, “Security Considerations,” on page 447 

+ Appendix A, “Console Commands for Novell Cluster Services,” on page 449 

+ Appendix B, “Files for Novell Cluster Services,” on page 479 

+ Appendix C, “Electing a Master Node,” on page 483 

+ Appendix D, “Clusters Plug-In Changes for Novell iManager 2.7.5,” on page 487 

+ Appendix E, “ Documentation Updates,” on page 493 


Audience 


This guide is intended for cluster administrators, or anyone who is involved in installing, configuring, 
and managing Novell Cluster Services. 


Understanding of file systems and services that are used in the cluster is assumed. 


Feedback 
We want to hear your comments and suggestions about this manual and the other documentation 


included with this product. Please use the User Comments feature at the bottom of each page of the 
online documentation. 
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Documentation Updates 

The latest version of this Novell Cluster Services for Linux Administration Guide is available on the 
OES 11 SP3 documentation website (http://www.novell.com/documentation/oes11/). 

Additional Documentation 


For information about other OES products, see the OES 11 SP3 documentation website (http:// 
www.novell.com/documentation/oes11/). 


For links to information about clustering OES services and Linux services with Novell Cluster 
Services, see Chapter 11, “Quick Reference for Clustering Services and Data,” on page 233. 


For information about using Novell Cluster Services in a VMware virtual environment, see the OES 11 
SP3: Novell Cluster Services Implementation Guide for VMware. 


For information about converting clusters from NetWare to Linux, see the OES 11 SP3: Novell Cluster 
Services NetWare to Linux Conversion Guide. 


For information about Novell Cluster Services for NetWare 6.5 SP8, see the “Clustering NetWare 
Services” list on the NetWare 6.5 SP8 Clustering (High Availability) documentation website (http:// 
www.novell.com/documentation/nw65/cluster-services.html#clust-config-resources). 


OES 11 SP3: Novell Cluster Services for Linux Administration Guide 


1.1 


Overview of Novell Cluster Services 


Novell Cluster Services for Novell Open Enterprise Server (OES) is a multiple-node server clustering 
system that ensures high availability and manageability of critical network resources including data, 
applications, and services. It stores information in NetIQ eDirectory about the cluster and its 
resources. It supports failover, failback, and cluster migration of individually managed cluster 
resources. You can cluster migrate a resource to a different server in order to perform rolling cluster 
maintenance or to balance the resource load across member nodes. 


¢ Section 1.1, “Why Should | Use Clusters?,” on page 17 

¢ Section 1.2, “Benefits of Novell Cluster Services,” on page 18 
¢ Section 1.3, “Product Features,” on page 18 

¢ Section 1.4, “Clustering for High Availability,” on page 18 

¢ Section 1.5, “Shared Disk Scenarios,” on page 20 


¢ Section 1.6, “Terminology,” on page 23 


Why Should | Use Clusters? 


A server cluster is a group of redundantly configured servers that work together to provide highly 
available access for clients to important applications, services, and data while reducing unscheduled 
outages. The applications, services, and data are configured as cluster resources that can be failed 
over or cluster migrated between servers in the cluster. For example, when a failure occurs on one 
node of the cluster, the clustering software gracefully relocates its resources and current sessions to 
another server in the cluster. Clients connect to the cluster instead of an individual server, so users 
are not aware of which server is actively providing the service or data. In most cases, users are able 
to continue their sessions without interruption. 


Each server in the cluster runs the same operating system and applications that are needed to 
provide the application, service, or data resources to clients. Storage is shared among servers. In 
case of failures, data can remain available through a different path. Clustering software monitors the 
health of each of the member servers by listening for its heartbeat, a simple message that lets the 
others know it is alive. 


The cluster’s virtual server provides a single point for accessing, configuring, and managing the 
cluster servers and resources. The virtual identity is bound to the cluster’s master node and remains 
with the master node regardless of which member server acts the master node. The master server 
also keeps information about each of the member servers and the resources they are running. If the 
master server fails, the control duties are passed to another server in the cluster. 
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1.2 Benefits of Novell Cluster Services 


Novell Cluster Services provides high availability for data and services running on OES servers. You 
can configure up to 32 OES servers in a high-availability cluster, where resources can be dynamically 
relocated to any server in the cluster. Each cluster resource can be configured to automatically fail 
over to a preferred server if there is a failure on the server where it is currently running. In addition, 
costs are lowered through the consolidation of applications and operations onto a cluster. 


Novell Cluster Services allows you to manage a cluster from a single point of control and to adjust 
resources to meet changing workload requirements (thus, manually “load balance” the cluster). 
Resources can also be cluster migrated manually to allow you to troubleshoot hardware. For 
example, you can move applications, websites, and so on to other servers in your cluster without 
waiting for a server to fail. This helps you to reduce unplanned service outages and planned outages 
for software and hardware maintenance and upgrades. 


Novell Cluster Services clusters provide the following benefits over stand-alone servers: 


¢ Increased availability of applications, services, and data 
+ Improved performance 

+ Lower cost of operation 

¢ Scalability 

¢ Disaster recovery 

¢ Data protection 

¢ Server consolidation 


¢ Storage consolidation 


1.3 Product Features 


Novell Cluster Services includes several important features to help you ensure and manage the 
availability of your network resources: 


¢ Support for shared SCSI, iSCSI, or Fibre Channel storage subsystems. Shared disk fault 
tolerance can be obtained by implementing RAID on the shared disk subsystem. 


¢ Multi-node all-active cluster (up to 32 nodes). Any server in the cluster can restart resources 
(applications, services, IP addresses, and file systems) from a failed server in the cluster. 


+ A single point of administration through the browser-based Novell iManager, which allows you to 
remotely manage the cluster. You can use the Clusters plug-in to manage and monitor clusters 
and cluster resources, and to configure the settings and scripts for cluster resources. 


¢ The ability to tailor a cluster to the specific applications and hardware infrastructure that fit your 
organization. 


+ Dynamic assignment and reassignment of server storage as needed. 


+ The ability to use email to automatically notify administrators of cluster events and cluster state 
changes. 


1.4 Clustering for High Availability 


A Novell Cluster Services for Linux cluster consists of the following components: 


¢ 2to 32 OES 11 SP3 servers, each containing at least one local disk device. 
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+ Novell Cluster Services software running on each Linux server in the cluster. 


+ A shared disk subsystem connected to all servers in the cluster (optional, but recommended for 
most configurations). 


+ Equipment to connect servers to the shared disk subsystem, such as one of the following: 
+ High-speed Fibre Channel cards, cables, and switches for a Fibre Channel SAN 
¢ Ethernet cards, cables, and switches for an iSCSI SAN 
Ħ SCSI cards and cables for external SCSI storage arrays 


The benefits that Novell Cluster Services provides can be better understood through the following 
scenario. 


Suppose you have configured a three-server cluster, with a web server installed on each of the three 
servers in the cluster. Each of the servers in the cluster hosts two websites. All the data, graphics, 
and web page content for each website is stored on a shared disk system connected to each of the 
servers in the cluster. Figure 1-1 depicts how this setup might look. 


Figure 1-1 Three-Server Cluster 
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During normal cluster operation, each server is in constant communication with the other servers in 
the cluster and performs periodic polling of all registered resources to detect failure. 


Suppose Web Server 1 experiences hardware or software problems and the users who depend on 
Web Server 1 for Internet access, email, and information lose their connections. Figure 1-2 shows 
how resources are moved when Web Server 1 fails. 
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Figure 1-2 Three-Server Cluster after One Server Fails 
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Web Site A moves to Web Server 2 and Web Site B moves to Web Server 3. IP addresses and 
certificates also move to Web Server 2 and Web Server 3. 


When you configured the cluster, you decided where the websites hosted on each web server would 
go if a failure occurred. You configured Web Site A to move to Web Server 2 and Web Site B to move 
to Web Server 3. This way, the workload once handled by Web Server 1 is evenly distributed. 


When Web Server 1 failed, Novell Cluster Services software did the following: 


+ Detected a failure. 


+ Remounted the shared data directories (that were formerly mounted on Web Server 1) on Web 
Server 2 and Web Server 3 as specified. 


+ Restarted applications (that were running on Web Server 1) on Web Server 2 and Web Server 3 
as specified. 


+ Transferred IP addresses to Web Server 2 and Web Server 3 as specified. 


In this example, the failover process happened quickly and users regained access to website 
information within seconds, and in most cases, without logging in again. 


Now suppose the problems with Web Server 1 are resolved, and Web Server 1 is returned to a 
normal operating state. Web Site A and Web Site B automatically fail back (that is, they are moved 
back to Web Server 1) if failback is configured for those resources, and Web Server operation returns 
to the way it was before Web Server 1 failed. 


Novell Cluster Services also provides resource migration capabilities. You can move applications, 
websites, and so on to other servers in your cluster without waiting for a server to fail. 


For example, you could manually move Web Site A or Web Site B from Web Server 1 to either of the 
other servers in the cluster. You might want to do this to upgrade or perform scheduled maintenance 
on Web Server 1, or to increase performance or accessibility of the websites. 


Shared Disk Scenarios 


Typical cluster configurations normally include a shared disk subsystem connected to all servers in 
the cluster. The shared disk subsystem can be connected via high-speed Fibre Channel cards, 
cables, and switches, or it can be configured to use shared SCSI or iSCSI. If a server fails, another 
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designated server in the cluster automatically mounts the shared disk directories previously mounted 
on the failed server. This gives network users continuous access to the directories on the shared disk 


subsystem. 


¢ Section 1.5.1, “Using Fibre Channel Storage Systems,” on page 21 
¢ Section 1.5.2, “Using iSCSI Storage Systems,” on page 22 
¢ Section 1.5.3, “Using Shared SCSI Storage Systems,” on page 23 


Using Fibre Channel Storage Systems 


Fibre Channel provides the best performance for your storage area network (SAN). Figure 1-3 shows 


how a typical Fibre Channel cluster configuration might look. 


Figure 1-3 Typical Fibre Channel Cluster Configuration 
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1.5.2 Using iSCSI Storage Systems 


iSCSI is an alternative to Fibre Channel that can be used to create a lower-cost SAN with Ethernet 
equipment. Figure 1-4 shows how a typical iSCSI cluster configuration might look. 


Figure 1-4 Typical iSCSI Cluster Configuration 
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Using Shared SCSI Storage Systems 


You can configure your cluster to use shared SCSI storage systems. This configuration is also a 
lower-cost alternative to using Fibre Channel storage systems. Figure 1-5 shows how a typical 
shared SCSI cluster configuration might look. 


Figure 1-5 Typical Shared SCSI Cluster Configuration 
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Before you start working with a Novell Cluster Services cluster, you should be familiar with the terms 
described in this section: 

¢ Section 1.6.1, “The Cluster,” on page 23 

è Section 1.6.2, “Cluster Resources,” on page 24 


¢ Section 1.6.3, “Failover Planning,” on page 26 


The Cluster 


A cluster is a group 2 to 32 servers configured with Novell Cluster Services so that data storage 
locations and applications can transfer from one server to another to provide high availability to users. 

+ “Cluster IP Address” on page 24 

¢ “Server IP Address” on page 24 

+ “Master Node” on page 24 

¢ “Slave Node” on page 24 

¢ “Split-Brain Detector (SBD)” on page 24 

+ “Shared Storage” on page 24 
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Cluster IP Address 


The unique static IP address for the cluster. 


Server IP Address 


Each server in the cluster has its own unique static IP address. 


Master Node 


The first server that comes up in an cluster is assigned the cluster IP address and becomes the 
master node. The master node monitors the health of the cluster nodes. It also synchronizes updates 
about the cluster to eDirectory. If the master node fails, Cluster Services migrates the cluster IP 
address to another server in the cluster, and that server becomes the master node. For information 
about how a new master is determined, see Appendix C, “Electing a Master Node,” on page 483. 


Slave Node 


Any member node in the cluster that is not currently acting as the master node. 


Split-Brain Detector (SBD) 


A small shared storage device where data is stored to help detect and prevent a split-brain situation 
from occurring in the cluster. If you use shared storage in the cluster, you must create an SBD for the 
cluster. 


A split brain is a situation where the links between the nodes fail, but the nodes are still running. 
Without an SBD, each node thinks that the other nodes are dead, and that it should take over the 
resources in the cluster. Each node independently attempts to load the applications and access the 
data, because it does not know the other nodes are doing the same thing. Data corruption can occur. 
An SBD'’s job is to detect the split-brain situation, and allow only one node to take over the cluster 
operations. 


Shared Storage 


Disks or LUNs attached to nodes in the cluster via SCSI, Fibre Channel, or iSCSI fabric. Only devices 
that are marked as shareable for clustering can be cluster-enabled. 


1.6.2 Cluster Resources 


A cluster resource is a single, logical unit of related storage, application, or service elements that can 
be failed over together between nodes in the cluster. The resource can be brought online or taken 
offline on one node at a time. 

+ “Resource IP Address” on page 25 

+ “NCS Virtual Server” on page 25 

+ “Resource Templates” on page 25 

¢ “Service Cluster Resource” on page 25 

+ “Pool Cluster Resource” on page 25 

+ “Linux POSIX Volume Cluster Resource” on page 26 
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+ “NCP Volume Cluster Resource” on page 26 
+ “DST Volume Cluster Resource” on page 26 


¢ “Cluster Resource Scripts” on page 26 


Resource IP Address 


Each cluster resource in the cluster has its own unique static IP address. 


NCS Virtual Server 


An abstraction of a cluster resource that provides location independent access for users to the 
service or data. The user is not aware of which node is actually hosting the resource. Each cluster 
resource has a virtual server identity based on its resource IP address. A name for the virtual server 
can be bound to the resource IP address. 


Resource Templates 


A resource template contains the default load, unload, and monitor scripts and default settings for 
service or file system cluster resources. Resource templates are available for the following OES 
services and file systems: 

+ Novell Archive and Version Services (removed in OES 11 SP3) 

+ Novell DHCP 

+ Novell DNS 

+ Generic file system (for LVM-based Linux POSIX volumes) 

+ NSS file system (for NSS pool resources) 

+ Generic IP service 

+ Novell iFolder 3.x 

e Novell iPrint 

+ MySQL 

+ Novell Samba 


Personalized templates can also be created. See Section 10.3, “Using Cluster Resource Templates, 
on page 200. 


Service Cluster Resource 


An application or OES service that has been cluster-enabled. The application or service is installed 
on all nodes in the cluster where the resource can be failed over. The cluster resource includes 
scripts for loading, unloading, and monitoring. The resource can also contain the configuration 
information for the application or service. 


Pool Cluster Resource 


A cluster-enabled Novell Storage Services pool. Typically, the shared pool contains only one NSS 
volume. The file system must be installed on all nodes in the cluster where the resource can be failed 
over. The NSS volume is bound to an NCS Virtual Server object (NcS:NCP Server) and to the 
resource IP address. This provides location independent access to data on the volume for NCP, 
Novell AFP, and Novell CIFS clients. 
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Linux POSIX Volume Cluster Resource 


A cluster-enabled Linux POSIX volume. The volume is bound to the resource IP address. This 
provides location-independent access to data on the volume via native Linux protocols such as 
Samba or FTP. You can optionally create an NCS Virtual Server object (NCS:NCP Server) for the 
resource as described in Section 13.5, “Creating a Virtual Server Object for an LVM Volume Group 
Cluster Resource,” on page 367. 


NCP Volume Cluster Resource 


An NCP volume (or share) that has been created on top of a cluster-enabled Linux POSIX volume. 
The NCP volume is re-created by a command in the resource load script whenever the resource is 
brought online. The NCP volume is bound to an NCS Virtual Server object (NcS:NCP Server) and to 
the resource IP address. This provides location-independent access to the data on the volume for 
NCP clients in addition to the native Linux protocols such as Samba or FTP. You must create an NCS 
Virtual Server object (NCS:NCP Server) for the resource as described in Section 13.5, “Creating a 
Virtual Server Object for an LVM Volume Group Cluster Resource,” on page 367. 


DST Volume Cluster Resource 


A cluster-enabled Novell Dynamic Storage Technology volume made up of two shared NSS volumes. 
Both shared volumes are managed in the same cluster resource. The primary volume is bound to an 
NCS Virtual Server object (NcS:NCP Server) and to the resource IP address. This provides location 
independent access to data on the DST volume for NCP and Novell CIFS clients. (Novell AFP does 
not support DST volumes.) 


If Novell Samba is used instead of Novell CIFS, the cluster resource also manages FUSE and 
ShadowFS. You point the Samba configuration file to /media/shadowfs/dst_primary_volume_name 
to provide users a merged view of the data. 


Cluster Resource Scripts 


Each cluster resource has a set of scripts that are run to load, unload, and monitor a cluster resource. 
The scripts can be personalized by using the Clusters plug-in for iManager. 


Failover Planning 


+ “Heartbeat” on page 27 

+ “Quorum” on page 27 

+ “Preferred Nodes” on page 27 

¢ “Resource Priority” on page 27 

+ “Resource Mutual Exclusion Groups” on page 27 
+ “Failover” on page 27 

+ “Fan-Out Failover” on page 27 

+ “Failback” on page 27 

¢ “Cluster Migrate” on page 27 

+ “Leave a Cluster” on page 27 


+ “Join a Cluster” on page 28 
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Heartbeat 


A signal sent between a slave node and the master node to indicate that the slave node is alive. This 
helps to detect a node failure. 


Quorum 


The administrator-specified number of nodes that must be up and running in the cluster before cluster 
resources can begin loading. 


Preferred Nodes 
One or more administrator-specified nodes in the cluster that can be used for a resource. The order 


of nodes in the Preferred Nodes list indicates the failover preference. Any applications that are 
required for a cluster resource must be installed and configured on the assigned nodes. 


Resource Priority 


The administrator-specified priority order that resources should be loaded on a node. 


Resource Mutual Exclusion Groups 
Administrator-specified groups of resources that should not be allowed to run on the same node at 


the same time. This Clusters plug-in feature is available only for clusters running OES 2 SP3 and 
later. 


Failover 
The process of automatically moving cluster resources from a failed node to an assigned functional 


node so that availability to users is minimally interrupted. Each resource can be failed over to the 
same or different nodes. 


Fan-Out Failover 


A configuration of the preferred nodes that are assigned for cluster resources so that each resource 
that is running on a node can fail over to different secondary nodes. 


Failback 


The process of returning cluster resources to their preferred primary node after the situation that 
caused the failover has been resolved. 


Cluster Migrate 


Manually triggering a move for a cluster resource from one node to another node for the purpose of 
performing maintenance on the old node, to temporarily lighten the load on the old node, and so on. 


Leave a Cluster 


A node leaves the cluster temporarily for maintenance. The resources on the node are cluster 
migrated to other nodes in their preferred nodes list. 
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Join a Cluster 


A node that has previously left the cluster rejoins the cluster. 
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2.1 


2.2 


What’s New or Changed for Novell 
Cluster Services 


This section describes enhancements and changes in Novell Cluster Services since the initial release 
of version 2.0 in Novell Open Enterprise Server (OES) 11. 


¢ Section 2.1, “What’s New (OES 11 SP3),” on page 29 
¢ Section 2.2, “What’s New (OES 11 SP2),” on page 29 
¢ Section 2.3, “What’s New (OES 11 SP1),” on page 34 
¢ Section 2.4, “What’s New (OES 11),” on page 37 


What’s New (OES 11 SP3) 


Besides bug fixes, there are no other changes for this component. 


What’s New (OES 11 SP2) 


Novell Cluster Services 2.2 supports OES 11 SP2 services and file systems running on 64-bit SUSE 
Linux Enterprise Server (SLES) 11 Service Pack (SP) 3. In addition to bug fixes, Novell Cluster 
Services provides the following enhancements and behavior changes in the OES 11 SP2 release. 


Changing the Nodes or Failover Order in the Preferred Nodes List 


When you change the nodes or failover order in a resource’s Preferred Nodes list, the change takes 
effect immediately when you click OK or Apply if the resource is running. Otherwise, it takes effect the 
next time the resource is brought online. Previously, the change did not occur until the cluster 
resource was taken offline and brought online. See “Configuring Preferred Nodes and Failover Order 
for a Resource” (http:/Awww.novell.com/documentation/oes11/clus_admin_Ix/data/hm13qb8q.html) in 
the OES 11 SP2: Novell Cluster Services for Linux Administration Guide (http://www.novell.com/ 
documentation/oes11/clus_admin_lx/data/bookinfo.html). 


With this new capability, changes for any resource attributes (Such as the resource mode settings, 
preferred nodes list, and RME groups) other than the scripts take effect immediately. 


Availability for prior releases: April 2013 Scheduled Maintenance for OES 11 SP1 


Applying Updated Scripts for a Resource 


When you modify the load, unload, and monitor scripts for a resource and click Apply or OK, the 
updated resource scripts can take effect in any of the following ways: 


+ When an administrator takes the resource offline and then brings it online. 
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+ When the resource fails over to another node, if both the source and destination nodes have 
received the updated scripts from eDirectory. 


+ When an administrator uses the cluster migrate command to load the resource on another 
node, if both the source and destination nodes have received the updated scripts from 
eDirectory. 


Previously, script changes did not take effect until the resource was taken offline and then brought 
online. 


For more information, see “Applying Updated Resource Scripts by Offline/Online, Failover, or 
Migration” (http://www.novell.com/documentation/oes11/clus_admin_lx/data/ 
apply_updated_scripts.html) in the OES 11 SP2: Novell Cluster Services for Linux Administration 
Guide (http://www.novell.com/documentation/oes11/clus_admin_|x/data/bookinfo.html). 


Availability for prior releases: April 2013 Scheduled Maintenance for OES 11 SP1 


Modifying Resource Scripts Outside of iManager 


You can use the /opt/novell/ncs/bin/nes_resource_scripts.pl script to modify resource 
scripts without using iManager. You can add, remove, or modify the commands in the script, or 
retrieve its scripts to search for information from the script. You can issue the command from the 
command line or in a script. This capability is very useful when you need to make the same script 
change to multiple resources in a cluster. See “ncs_resource_scripts.p! (Modifying Resource Scripts 
Outside of iManager” (http://www.novell.com/documentation/oes11/clus_admin_Ix/data/ 
ncs_resource_scripts.html) in the OES 11 SP2: Novell Cluster Services for Linux Administration 
Guide (http://www.novell.com/documentation/oes11/clus_admin_|x/data/bookinfo.html). 


Monitoring the Status of the eDirectory Daemon (ndsd) 


Some clustered services rely on the eDirectory daemon (ndsqd) to be running and available in order to 
function properly. In this release, NCS provides the ability to monitor the status of the eDirectory 
daemon (ndsd) at the NCS level. It is disabled by default. The monitor can be set independently on 
each node. On a node, if the eDirectory daemon does not respond to a status request within a 
specified timeout period, NCS can take one of three configurable remedy actions: an ndsd restart, a 
graceful node restart, or a hard node restart. See “Configuring NCS to Monitor the eDirectory 
Daemon” (http://www.novell.com/documentation/oes11/clus_admin_|x/data/ncs_monitor_ndsd.html) 
inthe OES 11 SP2: Novell Cluster Services for Linux Administration Guide (http://www.novell.com/ 
documentation/oes11/clus_admin_lx/data/bookinfo.html). 


Reporting Logged Events for a Specific Time Range 


You can get a report of logged events that occurred during a specified time range. The time range 
filter displays events that occurred during the interval of time before a specified date/time and after a 
specified date/time. The search includes the specified before and after values. For example, you 
might want to see events that occurred for a cluster resource before the date/time that a failover 
event was triggered and after the date/time of its previously known good state. See “Viewing Events 
in the Cluster Event Log” (http://www.novell.com/documentation/oes11/clus_admin_lx/data/ 
event_log.html) in the OES 11 SP2: Novell Cluster Services for Linux Administration Guide (http:// 
www.novell.com/documentation/oes11/clus_admin_lx/data/bookinfo.html). 


DotOutParser Utility 


The DotOutParser utility (/opt /novell/nes/bin/dotoutparser .p1) prints summaries of failed or 
incomplete events that have been recorded in a specified /var/opt /novell/log/ncs/ 

<resource name>.<script>.out log file. It also prints output (if any) from any commands that failed 
or got stuck. You can include ignored errors if desired. Line numbers allow you to easily refer the 
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summary output to the source lines in the *. out file. You can omit the line numbers if desired. See 
“DotOutParser Utility” (http:/Awww.novell.com/documentation/oes11/clus_admin_Ix/data/ 
dotoutparser.html) in the OES 11 SP2: Novell Cluster Services for Linux Administration Guide (http:// 
www.novell.com/documentation/oes11/clus_admin_lx/data/bookinfo.html). 


Ability to Manage a Cluster in Case of a Faulty Master IP Address 


The Clusters > My Clusters page in iManager provides the ability to manage the cluster with the IP 
address of a specified node (preferably the master node) if the master IP address for the Cluster 
object is experiencing problems. For example, a CIMOM error in iManager can prevent you from 
connecting to the master IP address, or an IP address conflict can prevent the Master IP Address 
Resource from coming online. See “Viewing or Modifying the Cluster Master IP Address or Port” 
(http:/www.novell.com/documentation/oesi11/clus_admin_Ix/data/clus_ip_port.html) in the OES 11 
SP2: Novell Cluster Services for Linux Administration Guide (http://www.novell.com/documentation/ 
oesi11/clus_admin_lx/data/bookinfo.html). 


Support for VLAN on NIC Bonding 


Novell Cluster Services added support for VLAN on NIC bonding. No modifications to scripts are 
required. You can use ethx or vlanx interfaces in any combination for nodes in a cluster. 


Availability for prior releases: September 2013 Scheduled Maintenance for OES 11 SP1 


Updates for the DHCP_Template 


In the DHCP_Template for DHCP cluster resources, the PID file location was changed to /var/1lib/ 
dhecp/var/run/dhcpd.pid. This is the location used by DHCP since OES 11 SP1. The change 
applies automatically to any newly created DHCP cluster resources. 


The following line in the load script for the DHCP_Template was modified to use the 
$MOUNT_POINT variable that is defined at the beginning of the script: 


exit_on_error /opt/novell/dhcp/bin/cluster dhcpd.sh -m S$MOUNT_POINT 


For information about configuring DHCP cluster resources, see “Configuring DHCP with Novell 
Cluster Services for the Linux File System” in the OES 11 SP3: Novell DNS/DHCP Services for Linux 
Administration Guide. 


Availability for prior releases: The PID path change is available in the May 2013 Scheduled 
Maintenance for OES 11 SP1. 


SLP Refresh Interval for Cluster Resource Virtual NCP Servers 


NCP Server was modified to refresh its OpenSLP registration of cluster resource virtual NCP servers, 
based on the setting for the eDirectory advertise-life-time (n4u.nds.advertise-life-time) 
parameter. The n4u.nds.advertise-life-time parameter is set by default to 3600 seconds (1 
hour) and has a valid range of 1 to 65535 seconds. Previously, NCP Server re-registered the virtual 
NCP servers with SLP every 30 minutes regardless of the eDirectory advertise-life-time setting. For 
information about setting the eDirectory advertise-life-time parameter in a cluster, see “SLP” (http:// 
www.novell.com/documentation/oes11/clus_admin_lx/data/ncs_swreqs.html#slp) in the OES 11 SP2: 
Novell Cluster Services for Linux Administration Guide (http://www.novell.com/documentation/oes11/ 
clus_admin_Ix/data/bookinfo.html). 


Availability for prior releases: May 2013 Scheduled Maintenance for OES 11 and OES 11 SP1 
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Enforcing Name Restrictions for NCP-Enabled LVM Volumes 


For NCP-enabled LVM volumes, the NSSMU utility and nlvm create linux volume command have 
been modified to enforce the NCP length restriction of 14 characters, and to use uppercase letters for 
the name in the Novell Cluster Services cluster resource scripts for a shared LVM volume. Previously, 
a new LVM volume cluster resource would go comatose immediately after creation if the name 
specified with the NCP_VOLUME parameter in the script was more than 14 characters or if it included 
lowercase letters. See “Creating an LVM Volume Group Cluster Resource with NSSMU?” (http:// 
www.novell.com/documentation/oes11/clus_admin_lx/data/bxv3rde.html#bxv32co) and “Creating an 
LVM Volume Group Cluster Resource with NLVM Commands” (http://www.novell.com/ 
documentation/oes11/clus_admin_|x/data/bxv3rde.html#b11dtkag) in the OES 11 SP2: Novell Cluster 
Services for Linux Administration Guide (http://www.novell.com/documentation/oes11/clus_admin_lx/ 
data/bookinfo.html). 


Availability for prior releases: November 2012 Scheduled Maintenance for OES 11 SP1 


Unsharing a Device without Stopping NCS 


NSS management tools have been modified so that it is not necessary to stop NCS from running in 
order to disable the Shareable for Clustering setting for a device. The device should not contribute 
space to an SBD partition or to a shared pool or a cluster-enabled pool that is used in any cluster 
resource. This change is consistent with how unsharing a device works on OES 2 SP3 and earlier. 
See “Stopping Novell Cluster Services” (http:/Avww.novell.com/documentation/oes11/clus_admin_Ix/ 
data/bscysdd.html) in the OES 11 SP2: Novell Cluster Services for Linux Administration Guide (http:// 
www.novell.com/documentation/oes11/clus_admin_lx/data/bookinfo.html). 


Availability for prior releases: September 2013 Scheduled Maintenance for OES 11 SP1 


Linux Multipath I/O Changes in SLES 11 SP3 


The Linux Device Mapper - Multipath software deprecated some attributes and modified some default 
settings for attributes in the /etc/multipath. conf file in SUSE Linux Enterprise Server 11 SP3. 
After upgrading to SLES 11 SP3, the multipathd daemon might not work with your existing multipath 
configuration file. Ensure that you verify your /etc/multipath.conf file before you start the 
multipathd daemon after an upgrade to OES 11 SP2. For information about the latest attributes and 
default settings, see the multipath. conf (5) man page after you install or upgrade the server. 


Key changes to the /etc/multipath. conf file: 
+ udev_dir 


The udev_dir attribute is deprecated. After you upgrade to SLES 11 SP3, you must remove or 
comment out the following line from the defaults section of your /etc/multipath.conf file: 


udev_dir /dev 


+ getuid_callout 


In the defaults section of the /etc/multipath.conf file, the getuid_callout attribute is 
deprecated and replaced by the uid_attribute attribute. This is a udev attribute that provides a 
unique path identifier. The default value is ID_SERIAL. 


After you upgrade to SLES 11 SP3, modify the attributes in the defaults section of your /etc/ 
multipath. conf file as follows: 


+ Remove or comment out the following line from the defaults section: 


getuid_callout "/lib/udev/scsi_id --whitelisted --device=/dev/%n" 
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¢ Add the following line to the defaults section: 
uid_attribute "ID SERIAL" 


+ path_selector 


In the defaults section of the /etc/multipath.conf file, the default value for the 
path_selector attribute was changed from "round-robin 0" to "service-time 0". The 
service-time option chooses the path for the next bunch of I/O based on the amount of 
outstanding I/O to the path and its relative throughput. 


After you upgrade to SLES 11 SP3, you can modify the attribute value in the defaults section of 
your /etc/multipath.conf file to use the recommended default: 


path_selector "service-time 0" 


+ user_friendly_ names 


The user friendly names attribute can be configured in the devices section and in the 
multipaths section. 


+ max_fds 


The default setting for the max_fds attribute was changed to max. This allows the multipath 
daemon to open as many file descriptors as the system allows when it is monitoring paths. 


After you upgrade to SLES 11 SP3, you can modify the attribute value in your /etc/ 
multipath. conf file: 


max_fds "max" 


These key changes are shown in the following defaults section for the /etc/multipath.conf file. 
This example comments out the old settings and adds the new or revised settings: 


defaults { 
verbosity 2 
udev_dir is deprecated in SLES 11 SP3 
udev_dir /dev 
polling interval 10 
path_selector default value is service-time in SLES 11 SP3 
path_selector "round-robin 0" 
path_selector "service-time 0" 
path_grouping policy "failover" 
getuid_callout is deprecated in SLES 11 SP3 and replaced with uid_attribute 
getuid_callout "/lib/udev/scsi_id --whitelisted --device=/dev/%n" 
uid_attribute is new in SLES 11 SP3 
uid_attribute "ID SERIAL" 
prio "const" 
prio_args iir 
features won 
path_checker "directio" 
alias_prefix "mpath" 
# rr_min_io was deprecated in SLES 11 SP2 
# rr min io 100 
# rr min io_rq is new in SLES 11 SP2 
rr min _io_ rq 1 
# max_fds default is max in SLES 11 SP3 
# max_fds 8124 
max_fds "max" 
rr weight "uniform" 
queue_without_daemon "yes" 
flush_on_last_del "mo" 
user_friendly_names "mo" 
fast_io_fail_tmo 5 
bindings file "/etc/multipath/bindings" 
wwids file "/etc/multipath/wwids" 
log_checker_err "always" 
retain_attached_hw_handler "no" 
detect_prio "no" 
failback "manual" 
no_path_retry "fail" 
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For information about the requirements, configuration, and management of multipath I/O, see 
“Managing Multipath I/O for Devices” (http://www.suse.com/documentation/sles11/stor_admin/data/ 
multipathing.html) in the SUSE Linux Enterprise Server 11 SP3 Storage Administration Guide (http:// 
www.suse.com/documentation/sles11/stor_admin/data/bookinfo.html). 


What’s New (OES 11 SP1) 


Novell Cluster Services 2.1 supports OES 11 SP1 services and file systems running on 64-bit SUSE 
Linux Enterprise Server 11 SP2. In addition to bug fixes, Novell Cluster Services provides the 
following enhancements and behavior changes in the OES 11 SP1 release: 


Cluster-Enabling an Existing Pool 


In the Clusters plug-in to iManager, when you cluster-enable an existing Novell Storage Services 
(NSS) pool, the Online Resource after Creation option on the Cluster Pool Information page is 
available and deselected by default. If the pool is deactive when you cluster-enable it, you can select 
this option to automatically bring the resource online, which activates the pool on a preferred node 
and mounts the pool’s volumes. 


Previously, the option was deselected and dimmed, the resource was automatically placed in an 
offline state, and no action was taken for the state of the pool and its volumes. 


For information, see “Cluster-Enabling an Existing NSS Pool and Its Volumes” (http:// 
www.novell.com/documentation/oes11/clus_admin_lx/data/hrtOekvg.html) in the OES 11 SP1: Novell 
Cluster Services for Linux Administration Guide (http://www.novell.com/documentation/oes11/ 
clus_admin_Ix/data/bookinfo.html). 


Default CIFS Virtual Server Name 


When you enable Novell CIFS as an advertising protocol for a cluster-enabled pool, the default name 
is based on the NCP virtual server object name. If you change the NCP virtual server name in 
NSSMU or in the Storage plug-in for iManager, the CIFS virtual server name is updated accordingly. 
For information, see “Novell CIFS for Linux” (http://www.novell.com/documentation/oes11/ 
clus_admin_Ix/data/bff13ks.html#bghOtjp) in the OES 11 SP1: Novell Cluster Services for Linux 
Administration Guide (http:/Awww.novell.com/documentation/oes11/clus_admin_Ix/data/ 
bookinfo.html). 


Enabling NCP for a Clustered Linux POSIX Volume Group 


When you create a cluster-enabled Linux POSIX volume group with NSSMU or with the nlvm create 
linux volume command, you can use the ncp option to enable users to access the Linux POSIX file 
system on the volume with the NetWare Core Protocol (NCP). Previously, the NCP volume (share) 
was created manually after the resource was created and brought online. 


For information, see “Configuring an LVM Volume Group Cluster Resource with NSS Management 
Tools” (http://www.novell.com/documentation/oes11/clus_admin_Ix/data/bxv3rde.html) in the OES 11 
SP1: Novell Cluster Services for Linux Administration Guide (http://www.novell.com/documentation/ 
oesi11/clus_admin_lx/data/bookinfo.html). 


Btrfs File System 


The SUSE Linux Enterprise Server 11 SP2 operating system supports the Btrfs file system. The 
btrfsprogs package must be installed. 
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Novell Cluster Services supports using the Birfs file system when you create a clustered Linux LVM 
volume group by using the NSS Management Utility (NSSMU) or Novell Linux Volume Manager 
(NLVM) commands. If you use Linux commands to create the LVM volume group, you can use the 
mkfs.btrfs (8) Command to add the Btrfs file system to the volume. You specify btrfs as the file 
system type for the LVM volume group cluster resource. You can enable NCP file access for the Birfs 
volume. 


For information, see “Configuring an LVM Volume Group Cluster Resource with NSS Management 
Tools” (http://www.novell.com/documentation/oes11/clus_admin_lx/data/bxv3rde.html) in the OES 11 
SP1: Novell Cluster Services for Linux Administration Guide (http://www.novell.com/documentation/ 
oesi11/clus_admin_lx/data/bookinfo.html). 


Cluster Migrate Command 


The cluster migrate command now offers the -list, -most, and -next options. For information, 
see “MIGRATE” in the Cluster Management Commands table (https://www. novell.com/ 
documentation/oes11/clus_admin_lx/data/cluster_commands.html#b2klg4d) of the OES 11 SP1: 
Novell Cluster Services for Linux Administration Guide (http://www.novell.com/documentation/oes11/ 
clus_admin_Ix/data/bookinfo.html). 


Clusters Plug-in for iManager 


The Clusters plug-in for iManager 2.7.5 has been reorganized. In Roles and Tasks under Clusters, 
the Cluster Manager, BCC Manager, Cluster Event Log, and Cluster Options menu items have been 
replaced with two options: My Clusters and My Resources. Links on the these pages take you to the 
familiar cluster options presented as tabs: Cluster Manager, BCC Manager, Cluster Event Log, and 
Cluster Options. 


¢ My Clusters: The logged-in cluster administrator can set up a personalized list of clusters to 
manage. This allows an administrator to view at a glance the status of multiple clusters. An 
administrator can also customize the display to sort the entries, modify the columns, or filter the 
entries. The list of clusters and display preferences persist between the administrator’s logins to 
iManager on the same server. For information, see “Setting Up a Personalized List of Clusters to 
Manage” (http://www.novell.com/documentation/oes11/clus_admin_Ix/data/myclusters.html) in 
the OES 11 SP1: Novell Cluster Services for Linux Administration Guide (http://www.novell.com/ 
documentation/oes11/clus_admin_|Ix/data/bookinfo.html). 


+ My Resources: The logged-in cluster administrator can set up a personalized list of cluster 
resources to manage. This allows an administrator to view at a glance the status of multiple 
cluster resources for multiple clusters. An administrator can also customize the display to sort 
the entries, modify the columns, or filter the entries. The list of cluster resources and display 
preferences persist between the administrator’s logins to iManager on the same server. For 
information, see “Setting Up a Personalized List of Resources to Manage” (http:// 
www.novell.com/documentation/oes11/clus_admin_Ix/data/myresources.html) in the OES 11 
SP1: Novell Cluster Services for Linux Administration Guide (http://www.novell.com/ 
documentation/oes11/clus_admin_lx/data/bookinfo.html). 


The Clusters plug-in supports the management of OES and NetWare clusters and resources. It 
cannot be installed on a NetWare server. 


If you use Role-Based Services (RBS), upgrading the Clusters plug-in does not automatically update 
the RBS settings. The RBS Configuration page reports that the Clusters plug-in is out-of-date. The 
plug-in must be reinstalled on the RBS Configuration page in order to pick up the My Clusters and My 
Resources menu options. For information, see “Updating Role-Based Services for the Clusters Plug- 
in for OES 11 SP1” (http:/Awww.novell.com/documentation/oes11/clus_admin_Ix/data/ 


What’s New or Changed for Novell Cluster Services 35 


inst_clusters.html#inst_clusters_rb) in the OES 11 SP1: Novell Cluster Services for Linux 
Administration Guide (http://www.novell.com/documentation/oes11/clus_admin_|x/data/ 
bookinfo.html). 


A comparison of the old and new interface is available in “Clusters Plug-In Changes for Novell 
iManager 2.7.5” (http:/Awww.novell.com/documentation/oes11/clus_admin_Ix/data/ 
apdx_clusters_plugin_changes.html) in the OES 11 SP1: Novell Cluster Services for Linux 
Administration Guide (http:/Awww.novell.com/documentation/oes11/clus_admin_|x/data/ 
bookinfo.html). 


Availability for prior releases: January 2013 Scheduled Maintenance for OES 11 


STONITH 


The STONITH (shoot-the-other-node-in-the-head) capability allows Novell Cluster Services to kill a 
suspect node by using remote power control. Unlike a poison pill, it does not require a response from 
the suspect node. STONITH is used after a poison pill is issued; it does not replace the poison pill. 
For information, see “Configuring STONITH” (http:/Awww.novell.com/documentation/oes11/ 
clus_admin_Ix/data/stonith.html) in the OES 11 SP1: Novell Cluster Services for Linux Administration 
Guide (http://www.novell.com/documentation/oes11/clus_admin_Ix/data/bookinfo.html). 


Master Election Process 


Novell Cluster Services for OES 11 SP1 introduces some intelligence in the master election process 
when the master leaves a cluster (voluntarily or involuntarily). The same master is elected under both 
the old and new algorithms, but the conclusion is reached sooner, especially for larger clusters. The 
new algorithm substantially reduces the time needed for master election in some cases. 


For information about the old and new algorithms, see “Electing a Master Node” (http:// 
www.novell.com/documentation/oes11/clus_admin_lx/data/ncs_master_election.html) in the OES 11 
SP1: Novell Cluster Services NetWare to Linux Conversion Guide (http://www.novell.com/ 
documentation/oes11/clus_conversion_lx/data/bookinfo.html). 


Availability for prior releases: September 2012 Scheduled Maintenance for OES 11 


NetWare to Linux Cluster Conversion: File Access Protocol Commands for 
Monitor Scripts 


When you convert NetWare 6.5 SP8 clusters to OES 11 SP1, if the AFP or CIFS protocols are 
configured as advertising protocols for an NSS pool cluster resource on the NetWare cluster, the 
corresponding monitoring commands are automatically added to the monitor script for the resource 
on OES 11 SP1. Monitoring is not available for NetWare clusters and is disabled while the cluster is in 
mixed mode. Monitoring can be enabled for the resource after the final cluster conversion is 
complete. For information, see “File Access Protocols for Monitor Scripts” (http://www.novell.com/ 
documentation/oesi11/clus_conversion_lx/data/bh9em7s.html#b115ip7x) in the OES 11 SP1: Novell 
Cluster Services NetWare to Linux Conversion Guide (http://www.novell.com/documentation/oes11/ 
clus_conversion_|Ix/data/bookinfo.html). 


DHCP Cluster Resource: Path Change for dhcpd.pid 


The DHCP process ID file location was changed from /var/run/dhcpd.pid to /var/lib/dhcp/var/ 
run/dhcpd.pid. During a cluster upgrade from OES 11 to OES 11 SP1, you must modify the location 
of the dhcpd.pid file in the DHCP cluster resource’s unload script. After you modify the script, you 
should bring the resource online only on OES 11 SP1 nodes. This is necessary to ensure a graceful 
shutdown of the dhcpd.pid process when the DHCP resource fails over to a different node. For 
information, see “Path Change for dhcpd.pid” and “Changing the Path for dhcpd.pid” in the OES 11 
SP3: Novell DNS/DHCP Services for Linux Administration Guide. 


36 OES 11 SP3: Novell Cluster Services for Linux Administration Guide 


2.4 


Change in the Command Sequence for Pool Cluster Resource Scripts 


The default sequence of commands has changed for the load script and unload script of newly 
created NSS pool cluster resources. In the load script, the secondary IP address is added after the 
volumes are mounted. In the unload script, the secondary IP address is removed before the pool is 
deactivated. 


The new sequence improves the handling of client reconnects because it leverages the clients’ auto- 
reconnect mechanisms. With the previous order, clients might attempt to connect to the IP address 
before the data is ready or after the data is unavailable, which results in an object Not Found error. 
Some clients might automatically try again to connect, but some do not. Thus, it is more efficient to 
add the IP address after data is available and remove it before the data is not available. 


Newly created pool cluster resources use the following sequence for commands in a load script. The 
order is reversed in an unload script. 


NSS 

[NFS] (If NFS is used, you manually add the command here.) 
Secondary IP address 

NCP 

[AFP] 

[CIFS] 


Existing scripts are not modified during a cluster upgrade. We recommend that you modify the 
command sequence accordingly in your existing load scripts and unload scripts for pool cluster 
resources. 


What’s New (OES 11) 


Novell Cluster Services 2.0 supports OES 11 services and file systems running on 64-bit SUSE Linux 
Enterprise Server 11 SP1. In addition to bug fixes and performance improvements, it includes the 
following changes and enhancements: 


EVMS Is Deprecated 


The Enterprise Volume Management System (EVMS) has been deprecated in SLES 11, and is also 
deprecated in OES 11. Novell Linux Volume Manager (NLVM) replaces EVMS for managing NetWare 
partitions under Novell Storage Services (NSS) pools. 


NSS Pool Cluster Resources 


Novell Cluster Services for OES 11 supports NSS pools that are created on OES 11, OES 2 SP3 and 
earlier, and NetWare 6.5 SP8. 


A new NSS capability supports the GPT partitioning scheme. This allows you to create NSS pools up 
to 8 TB (terabytes) in size on a single device. Pools created with GPT-partitioned devices are not 
backward compatible with prior releases of OES and NetWare. The DOS partitioning scheme is also 
available and supports devices up to 2 TB in size. 


The NSS management tools use the Novell Linux Volume Manager instead of the Enterprise Volume 
Management System that is used in previous OES releases. The Storage plug-in to iManager and 
NSSMU can be used to create pool cluster resources. You can also use NLVM commands to create 
shared pools and volumes at a command prompt or in scripts. 
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During a rolling cluster upgrade, the existing NSS pool cluster resources can be cluster migrated to 
any node in the mixed-node cluster. However, you must not create new NSS pools on OES 11 nodes 
while you are upgrading the cluster from OES 2 to OES 11. For information, see “NSS Pools” (http:// 
www.novell.com/documentation/oes11/clus_admin_Ix/data/btvuil3.html#btvv2vn) in the OES 11: 
Novell Cluster Services for Linux Administration Guide (http://www.novell.com/documentation/oes11/ 
clus_admin_Ix/data/bookinfo.html). 


LVM Volume Group Cluster Resources 


Novell Cluster Services uses a Linux Logical Volume Manager (LVM) volume group and logical 
volume to create the cluster resource for shared Linux POSIX file systems (Such as Ext2, Ext3, 
ReiserFS, and XFS) on OES 11. 


The NSS Management Utility (NSSMU) and Novell Linux Volume Manager (NLVM) commands 
support creating Linux POSIX file systems and Linux Logical Volume Manager (LVM) volume groups 
and logical volumes. The tools support both the DOS and the GPT partitioning schemes. The DOS 
partitioning scheme supports devices up to 2 TB in size. The GPT partitioning scheme supports 
devices up to 8 zettabytes (ZB, or one billion terabytes). Your actual device size is limited by your 
storage hardware and the size recognized by your target file system. For information about maximum 
file system sizes on Linux, see the SUSE Linux Enterprise Server Technical Information: File System 
Support (http://www.suse.com/products/server/technical-information/#FileSystem). 


You can create a Linux volume group cluster resource by using NSSMU and Novell Linux Volume 
Manager commands. You can also use native Linux LVM2 commands to create a shared LVM 
volume group, and then create a resource by using the generic file system (Generic_FS) resource 
template in iManager, or by using other application resource templates that need shared Linux POSIX 
file systems. For information, see “Configuring and Managing Cluster Resources for an LVM volume 
groups” (http://www.novell.com/documentation/oes11/clus_admin_lx/data/ncsshvollxlvm.html) in the 
OES 11: Novell Cluster Services for Linux Administration Guide (http://www.novell.com/ 
documentation/oes11/clus_admin_|Ix/data/bookinfo.html). 


Linux POSIX Cluster Resources with CSM Containers 


On OES 2, Linux POSIX volume cluster resources use a Cluster Segment Manager (CSM) container 
on devices that are managed by EVMS. Because EVMS has been deprecated in OES 11, you must 
modify the scripts and cluster settings so that the CSM containers can run on OES 11 clusters. You 
cannot create new cluster resources with CSM containers on OES 11 clusters. For information, see 
“Upgrading and Managing Cluster Resources for Linux POSIX Volumes with CSM Containers” (http:/ 
/www.novell.com/documentation/oes11/clus_admin_lx/data/ncsshvollx.html) in the OES 11: Novell 
Cluster Services for Linux Administration Guide (http://www.novell.com/documentation/oes11/ 
clus_admin_Ix/data/bookinfo.html). 


CSMPORT Utility 


The Cluster Segment Manager Import/Export (CSMPORT, /opt/novell/nes/bin/csmport) utility 
allows you to import and use Linux POSIX volume cluster resources that use CSM containers in OES 
11 clusters. After the resource is configured to run on OES 11, you must configure its Preferred 
Nodes list to ensure that it can fail over only to OES 11 nodes in the mixed-node cluster. For 
information about CSMPORT, see “Cluster Segment Manager Import/Export (csmport) Utility” (http:// 
www.novell.com/documentation/oes11/clus_admin_lx/data/csmport.html) in the OES 11: Novell 
Cluster Services for Linux Administration Guide (http:/Awww.novell.com/documentation/oes11/ 
clus_admin_Ix/data/bookinfo.html). 
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Cluster Resource Templates Use LVM Volume Groups for Shared Data 
Locations 


The following cluster resource templates have been modified to use LVM volume groups and logical 
volumes for cluster resources that share data on Linux POSIX file systems. Previously, the templates 
used the EVMS Cluster Segment Manager container and Linux POSIX volumes. 


OES 11 Application Cluster Resource Template 
Archive and Version Services AV_Template 
DHCP DHCP_Template 


(for an NSS pool or for an LVM volume group) 


Linux POSIX file system Generic FS Template 


iFolder iFolder_ Template 


(for an NSS pool or for an LVM volume group) 


iPrint IPrint_ Template 


(for an NSS pool or for an LVM volume group) 


MySQL 5.x MySQL _ Template 
Samba Samba_Template 
Xen virtual machine Xen_Template 


The DNS_ Template uses an NSS file system. The Generic _IP_ Service and XenLive Template 
templates do not use a shared data location. 


The monitor scripts for resources that use a Linux volume group were modified to check the status of 
the LVM logical volume in addition to the file system and the IP address. 


Ext3 is the default file system type used in the scripts. The Ext2, Ext3, ReiserFS, and XFS file 
systems have been tested and are fully supported. 


Virtual Server Name for Cluster Resources 


The default virtual server name for cluster resources now uses hyphens instead of underscores, such 
as MYCLUS-MYPOOL-SERVER. The suggested name is compliant with the Internet Engineering Task 

Force (IETF) RFC 1123 standard that allows host names to contain only letters, digits, and hyphens. 
Underscores can still be used in the virtual server name if your network environment supports them. 


CIFS Monitor Command in the NSS Monitor Script 


Novell CIFS provides a monitor command option in OES 11 that provides a restart capability if the 
cifsd daemon goes down. If you create a new pool cluster resource with CIFS enabled as an 
advertising protocol, the following line is added to the resource’s monitor script: 


exit_on_error rcnovell-cifs monitor 


Previously, the CIFS status command was used. You can replace it with the monitor command for 
existing pool cluster resources to take advantage of the CIFS restart capability. For information, see 
“Configuring a Monitor Script for the Shared NSS Pool” (http://www.novell.com/documentation/oes11/ 
clus_admin_lIx/data/bffzoj5.html) in the OES 11: Novell Cluster Services for Linux Administration 
Guide (http://www.novell.com/documentation/oes11/clus_admin_|Ix/data/bookinfo.html). 
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Assigned Nodes List 


If you attempt to online or migrate a cluster resource to a node that is not in the resource’s Assigned 
Nodes list, the resource stays offline or is not migrated. This change makes the command behavior 

consistent with the online and migrate options in the Cluster plug-in in iManager. The node that you 

specify must be running in the cluster and must also be in the resource’s Assigned Nodes list. 


Previously, if the specified node was not a preferred node, the cluster online and cluster 
migrate commands brought the resource online on a node in its Assigned Nodes list. 


Order of Servers in the LDAP Server List 


When you configure the cluster node in YaST, the LDAP server list is created. The default order is to 
list the local LDAP server first and others second. In previous OES releases, the default order was 
based on the IP address. 


You cannot change the order of LDAP servers in the list during the cluster node configuration in YaST, 
but you can modify it later by running the /opt/novell/necs/install/ncs_install.py script. For 
information, see “Changing the Administrator Credentials or LDAP Server IP Address for a Cluster” 
(http:/Awww.novell.com/documentation/oes11/clus_admin_Ix/data/clus_moving.html#bgjnbuv) in the 
OES 11: Novell Cluster Services for Linux Administration Guide (http://www.novell.com/ 
documentation/oes11/clus_admin_lx/data/bookinfo.html). 


Cascade Failover Prevention 


Novell Cluster Services added the Cascade Failover Prevention function that detects if a node has 
failed because of a bad cluster resource and prevents that bad resource from failing over to other 
servers in the cluster. This function was previously available on NetWare, but not on Linux. 
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3.2 


Planning for a Cluster 


The success of your high-availability cluster solution depends on its stability and robustness. Use the 
guidelines in this section to design your Novell Cluster Services cluster and cluster environment. 


IMPORTANT: For information about the system requirements for installing and using Novell Cluster 
Services, see Chapter 4, “Planning for Novell Cluster Services,” on page 47. 


¢ Section 3.1, “Determining Your Design Criteria,” on page 41 

¢ Section 3.2, “Using Cluster Best Practices,” on page 41 

¢ Section 3.3, “Planning the LAN Connectivity,” on page 42 

¢ Section 3.4, “Planning the Shared Storage Connectivity,” on page 43 

¢ Section 3.5, “Planning the Shared Storage Solution,” on page 44 

¢ Section 3.6, “Planning the eDirectory Deployment,” on page 44 

¢ Section 3.7, “Planning for Shared Storage as Cluster Resources,” on page 45 


¢ Section 3.8, “Planning for OES Services as Cluster Resources,” on page 45 


Determining Your Design Criteria 


The purpose of designing a resilient cluster is to ensure that your essential data and services are 
highly available. Setting up data and services as cluster resources allows them to be moved between 
nodes in the same cluster. This helps eliminate or minimize the downtime caused by a server failure 
or maintenance. 


You can determine what data and services to set up as cluster resources by asking and answering 
the following questions: 


O What are the key services that drive your business? 

O What services are essential for business continuance? 
O What is the cost of downtime for the essential services? 
o 


Based on their mission-critical nature and cost of downtime, what services are the highest 
priority for business continuance? 


Q 


What data is necessary to support the highest-priority services? 


O How much data is involved, and how important is it? 


Using Cluster Best Practices 


Using the following cluster best practices can help you avoid potential problems with your cluster: 


¢ Ensure that eDirectory is stable before implementing a cluster. 


¢ Ensure that you have full Read/Write replicas of the entire eDirectory tree co-located in the data 
center where you are setting up the cluster. 
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3.3 


3.3.1 


3.3.2 


¢ Ensure that IP addresses are unique. 
¢ Consistently apply IP address assignments for each cluster and its cluster resources. 


+ Make IP address changes for the cluster and cluster resources only by using the procedure 
described in Section 8.13.2, “Moving a Cluster or Changing IP Addresses of Cluster Nodes and 
Resources,” on page 145. 


IP address changes for cluster resources should always be made on the Protocols page of the 
iManager Clusters plug-in, not directly in load, unload, and monitor scripts. This is the only way 
to change the IP address on the virtual NCS:NCP Server object in eDirectory. 


+ Ensure that Volume IDs used for a cluster resources are unique across all nodes. 


Each cluster node automatically assigns volume ID 0 to volume sys and volume ID 1 to volume 
_ ADMIN. Cluster-enabled volumes use high volume IDs, starting from 254 in descending order. 
Volume IDs can be assigned in the cluster load script. You can view the volume IDs assigned on 
anode by using the ncpcon volumes command. 


The Novell Client uses the volume ID to access a volume. 
¢ Consider each node’s configuration requirements for each of the services it is intended to host. 


+ Create failover matrixes for each cluster resource so that you know what service is supported 
and which nodes are the preferred nodes for failover. 


Planning the LAN Connectivity 


The primary objective of LAN connectivity in a cluster is to provide uninterrupted heartbeat 
communications. Use the guidelines in this section to design the LAN connectivity for the cluster: 
¢ Section 3.3.1, “VLAN,” on page 42 
¢ Section 3.3.2, “Channel Bonding,” on page 42 
¢ Section 3.3.3, “Spanning Tree Protocol,” on page 43 
¢ Section 3.3.4, “IP Addresses,” on page 43 


¢ Section 3.3.5, “Name Resolution,” on page 43 


VLAN 


Use a dedicated VLAN (virtual local area network) for each cluster. 


The cluster protocol is non-routable, so you cannot direct communications to specific IP addresses. 
Using a VLAN for the cluster nodes provides a protected environment for the heartbeat process and 
ensures that heartbeat packets are exchanged only between the nodes of a given cluster. 


When you use a VLAN, no foreign host can interfere with the heartbeat. For example, using a VLAN 
avoids broadcast storms that slow traffic and can result in false split-brain situations. 


Channel Bonding 


Servers should be redundantly cabled to the network in order to provide LAN fault tolerance, 
preferably at both the adapter level and the link level. Consider connecting cluster nodes to 
redundant access switches for fault tolerance. 


Use channel bonding for the server adapters. Channel bonding combines Ethernet interfaces ona 
host computer for redundancy or increased throughput. Higher-level software uses a single virtual- 
network interface, and the channel bonding driver handles the complex choice of which physical- 
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network interface to use. Channel bonding helps increase the availability of an individual cluster 
node, which helps avoid or reduce the occurrences of failover caused by slow LAN traffic. See the / 
usr/src/linux/Documentation/bonding.txt document. 


Spanning Tree Protocol 


Use the Spanning Tree Protocol (STP) to eliminate network topology loops. When you configure STP, 
ensure that the Portfast Bridge Protocol Data Unit (BPDU) guard feature is enabled, or consider using 
Rapid Spanning Tree Protocol (RSTP, IEEE 802.11w). 


The default settings for STP inhibit the heartbeat for over 30 seconds whenever there is a change in 
link status. Test your STP configuration with Novell Cluster Services running to ensure that a node is 
not cast out of the cluster when a broken link is restored. 


IP Addresses 


Plan your IP address assignment so that it is consistently applied across each cluster. For each 
cluster, provide a dedicated IP address range with sufficient addresses for the cluster. The addresses 
do not need to be contiguous. 


You need a unique static IP address for each of the following components of a cluster: 


+ Cluster (master IP address) 
¢ Cluster nodes 


¢ Cluster resources (file system resources and service resources such as DHCP, DNS, SLP, FTP, 
and so on) 


Name Resolution 


Ensure that SLP is properly configured for name resolution. See Section 4.6.4, “SLP,” on page 56. 


Planning the Shared Storage Connectivity 


The primary objective of the shared storage connectivity in a cluster is to provide solid and stable 
connectivity between cluster nodes and the storage system. Before installing Novell Cluster Services 
and setting up a cluster, ensure that the storage configuration is established and verified. 


Use the guidelines in this section to design the storage connectivity for a cluster: 


+ Use host-based multipath I/O management. See the following resources: 
¢ Section 4.10, “Multipath I/O Configuration Requirements,” on page 68 


+ “Managing Multipath I/O for Devices” (http:/Awww.suse.com/documentation/sles11/ 
stor_admin/data/multipathing.html) in the SLES 11 Storage Administration Guide (http:// 
www.suse.com/documentation/sles11/stor_admin/data/bookinfo.html) 


+ Connect each node via two fabrics to the storage area network (SAN). 


+ Use redundant SAN connections to provide fault-tolerant connectivity between the cluster nodes 
and the shared storage devices. 


+ Use LUN masking to exclusively assign each LUN to one or more host connections. See 
Section 4.9, “SAN Rules for LUN Masking,” on page 67. 
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Planning the Shared Storage Solution 


Use the guidelines in this section to design the shared storage solution for a cluster: 
+ For maximum flexibility, you should create only one cluster resource per LUN. 
A LUN cannot be concurrently accessed by servers belonging to different clusters. This means 
that all resources on a given LUN can be active only in a given cluster at any given time. 


+ You should use only one LUN per pool, and only one volume per pool. If you use multiple LUNs 
for a given shared NSS pool, all LUNs must fail over together. 


It is possible to create multiple pools per LUN or to use multiple LUNs per pool, but these 
alternatives are not recommended. 


Planning the eDirectory Deployment 


Your NetIQ eDirectory solution for each cluster must consider the following configuration elements. 
Your approach should be consistent across all clusters. 

¢ Section 3.6.1, “Object Location,” on page 44 

¢ Section 3.6.2, “Cluster OU Context,” on page 44 

¢ Section 3.6.3, “Cluster OU Partitioning and Replication,” on page 45 


Object Location 


Cluster nodes and Cluster objects can exist in any container in the eDirectory tree. The Virtual Server 
object for the cluster and the objects for cluster resources are automatically created in the eDirectory 
context of the server where the cluster resource is created and cluster-enabled. 


IMPORTANT: You should create cluster resources on the master node of the cluster. 


Cluster OU Context 


Before you create a new cluster, use iManager to create an OU container for the cluster, and use the 
OU container for the Cluster objects and Server objects. 


Figure 3-1 Example: Cluster1 Container and Its Objects 
fo] Novell iManager ir) 


Tree \ Browse \ Search \ 
ao AVALON_TREE 
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Cluster OU Partitioning and Replication 


Partition the Cluster OU, replicate it to dedicated eDirectory servers that are holding a replica of the 
parent partition, and replicate it to all cluster nodes. This helps prevent resources from being stuck in 
an NDS Sync state when a cluster resource’s configuration is modified. 


If you do not want to put a replica of eDirectory on the node, you must configure one or multiple LDAP 
servers for the node to use. The LDAP servers must have a master replica or a Read/Write replica of 
eDirectory. For information about how to modify the LDAP server list that is used by a cluster, see 
Section 8.13.1, “Changing the Administrator Credentials or LDAP Server IP Addresses for a Cluster,” 
on page 143. 


Planning for Shared Storage as Cluster Resources 


Novell Cluster Services supports using cluster resources for the following file systems and storage 
solutions: 


File System or Storage Solution See 

Novell Storage Services (NSS) pools Chapter 12, “Configuring and Managing Cluster 
Resources for Shared NSS Pools and Volumes,” on 
page 237 

Linux LVM volume groups and logical volumes Chapter 13, “Configuring and Managing Cluster 
Resources for Shared LVM Volume Groups,” on 
page 327 

Linux POSIX volumes Chapter 14, “Upgrading and Managing Cluster 


Resources for Linux POSIX Volumes with CSM 
Containers,” on page 399 


NCP (NetWare Control Protocol) volumes (NCP “Configuring NCP Volumes with Novell Cluster 
shares on cluster-enabled Linux POSIX volumes) Services” in the OES 11 SP3: NCP Server for Linux 
Administration Guide 


Dynamic Storage Technology (DST) volumes (NSS “Configuring DST Shadow Volume Pairs with Novell 
volumes configured in a shadow volume pair) Cluster Services” in the OES 11 SP3: Dynamic 
Storage Technology Administration Guide 


Planning for OES Services as Cluster Resources 


Novell Cluster Services supports using cluster resources for the following OES services: 


Service See 

Apache Web Server “Apache HTTP Server” in the OES 11 SP3: Novell 
Cluster Services NetWare to Linux Conversion Guide 

Apple Filing Protocol “Configuring AFP with Novell Cluster Services for an 
NSS File System” in the OES 11 SP3: Novell AFP for 

(Novell AFP) Linux Administration Guide 

Archive and Version Services “Configuring Archive and Version Service for Novell 


Cluster Services” in the OES 11 SP3: Novell Archive 
and Version Services Administration Guide 
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Service 


Certificate Server 


(NetIQ eDirectory Server Certificates) 


See 


“eDirectory Server Certificates” in the OES 11 SP3: 
Novell Cluster Services NetWare to Linux Conversion 
Guide 


CIFS “Configuring CIFS with Novell Cluster Services for an 
NSS File System” in the OES 11 SP3: Novell CIFS for 

(Novell CIFS) Linux Administration Guide 

DFS VLDB “Clustering Novell Distributed File Services” in the 


(Novell Distributed File Services Volume Location 
Database) 


OES 11 SP3: Novell Distributed File Services 
Administration Guide for Linux 


DHCP Server on a Linux POSIX volume 


“Configuring DHCP with Novell Cluster Services for 
the Linux File System” in the OES 11 SP3: Novell 
DNS/DHCP Services for Linux Administration Guide 


DHCP Server on an NSS volume 


DNS Server 


“Configuring DHCP with Novell Cluster Services for 
the NSS File System” in the OES 11 SP3: Novell DNS/ 
DHCP Services for Linux Administration Guide 


“Configuring DNS with Novell Cluster Services” in the 
OES 11 SP3: Novell DNS/DHCP Services for Linux 
Administration Guide 


iFolder 3.x 


“Clustering iFolder Servers with Novell Cluster 
Services for Linux” in the Novell iFolder 3.9.2 
Administration Guide 


iPrint 


“Configuring iPrint with Novell Cluster Services” in the 
OES 11 SP3: iPrint Linux Administration Guide 


MySQL 


“High Availability and Scalability” in the MySQL 5.x 
Reference Manual (http://dev.mysql.com/doc/refman/ 
5.5/en/ha-overview. html) 


“MySQL” in the OES 11 SP3: Novell Cluster Services 
NetWare to Linux Conversion Guide 


NetStorage 


“Configuring NetStorage with Novell Cluster Services” 
in the OES 11 SP3: NetStorage Administration Guide 
for Linux. 


PureFTPd 


(Novell FTP) 


“Cluster Enabling Pure-FTPd in an OES 11 SP3 
Environment” in the OES 11 SP3: Planning and 
Implementation Guide 


QuickFinder 5.0.x 


(Server Synchronization Feature) 


“QuickFinder Server” in the OES 11 SP3: Novell 
Cluster Services NetWare to Linux Conversion Guide 


Samba 


(Novell Samba) 


“Configuring Samba for LVM Volume Groups and 
Novell Cluster Services” in the OES 11 SP3: Novell 
Samba Administration Guide 
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Planning for Novell Cluster Services 


This section describes the requirements for installing and using Novell Cluster Services on Novell 
Open Enterprise Server (OES) 11 SP3 servers. 


IMPORTANT: For information about designing your cluster and cluster environment, see Chapter 3, 
“Planning for a Cluster,” on page 41. 


¢ Section 4.1, “Cluster Administration Requirements,” on page 47 

¢ Section 4.2, “IP Address Requirements,” on page 50 

¢ Section 4.3, “Volume ID Requirements,” on page 50 

¢ Section 4.4, “Hardware Requirements,” on page 51 

¢ Section 4.5, “Virtualization Environments,” on page 51 

¢ Section 4.6, “Software Requirements for Cluster Services,” on page 52 

¢ Section 4.7, “Software Requirements for Cluster Resources,” on page 61 
¢ Section 4.8, “Shared Disk Configuration Requirements,” on page 64 

¢ Section 4.9, “SAN Rules for LUN Masking,” on page 67 

¢ Section 4.10, “Multipath I/O Configuration Requirements,” on page 68 


Cluster Administration Requirements 


You use different credentials to install and set up the cluster and to manage the cluster. This section 
describes the tasks performed and rights needed for those roles. 

¢ Section 4.1.1, “Cluster Installation Administrator,” on page 47 

è Section 4.1.2, “NCS Proxy User,” on page 48 


¢ Section 4.1.3, “Cluster Administrator or Administrator-Equivalent User,” on page 50 


Cluster Installation Administrator 


Typically, a tree administrator user installs and sets up the first cluster in a tree, which allows the 
schema to be extended. However, the tree administrator can extend the schema separately, and then 
set up the necessary permissions for a container administrator to install and configure the cluster. 


NOTE: If the eDirectory administrator user name or password contains special characters (such as §, 
#, and so on), some interfaces in iManager and YaST might not handle the special characters. If you 
encounter problems, try escaping each special character by preceding it with a backslash (\) when 
you enter credentials. 


+ “eDirectory Schema Administrator” on page 48 


+ “Container Administrator” on page 48 
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eDirectory Schema Administrator 


A tree administrator user with credentials to do so can extend the eDirectory schema before a cluster 
is installed anywhere in a tree. Extending the schema separately allows a container administrator to 
install a cluster in a container in that same tree without needing full administrator rights for the tree. 


For instructions, see Section 5.2, “Extending the eDirectory Schema to Add Cluster Objects,” on 
page 72. 


IMPORTANT: It is not necessary to extend the schema separately if the installer of the first cluster 
server in the tree has the eDirectory rights necessary to extend the schema. 


Container Administrator 


After the schema has been extended, the container administrator (or non-administrator user) needs 
the following eDirectory rights to install Novell Cluster Services: 


¢ Attribute Modify rights on the NCP Server object of each node in the cluster. 
+ Object Create rights on the container where the NCP Server objects are. 
+ Object Create rights where the cluster container will be. 


For instructions, see Section 5.3, “Assigning Install Rights for Container Administrators or Non- 
Administrator Users,” on page 74. 


4.1.2 NCS Proxy User 


During the cluster configuration, you must specify an NCS Proxy User. This is the user name and 
password that Novell Cluster Services uses when the cluster management tools exchange 
information with eDirectory. 


Novell Cluster Services supports the OES Common Proxy User enablement feature of eDirectory. 
The proxy user is represented in eDirectory as a User object named 
OESCommonProxy_<server_name>.<context>. If the OES Common Proxy user is enabled in 
eDirectory when you configure a node for the cluster, the default NCS Proxy User is set to use the 
server's OES Common Proxy User. You can alternatively specify the LDAP Admin user or another 
administrator user. 


The specified NCS Proxy User for the node is automatically assigned as a member in the 
<cluster_name>_MGT_GRP.<context> group that resides in the Cluster object container, such as 
clusl_MGT_GRP.ncs.novell. The group accommodates the server-specific NCS Proxy Users that 
you assign when you configure each node for the cluster. Members are added to the group as you 
configure each node for a cluster. Each member of the group has the necessary rights for configuring 
the cluster and cluster resources and for exchanging information with eDirectory. 
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For example, Figure 4-1 shows that an OES Common Proxy User has been assigned as the NCS 
Proxy User for each node in a four-node cluster. The nodes are named avalon, camelot, excalibur, 
and cornwall. The context is novell. 


Figure 4-1 Members of the NCS Management Group for a Cluster 


Ee 


Modify Object: &@clus1_MGT_GRP.ncs.novell 
General \ Security \ Dynamic Nested \ LinuxProfile \ iPrint Client Management 
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| |) fal I 
OESCommonProxy_avalon.novell ~) 
OESCommonProxy_camelot.novell 
OESCommonProxy_excalibur.novell 
OESCommonProxy_cornwall.novell 


IMPORTANT: You can modify this default administrator user name or password for the user name 
assigned as the NCS Proxy User after the install by following the procedure in Section 8.13, “Moving 
a Cluster, or Changing the Node IP Addresses, LDAP Servers, or Administrator Credentials for a 
Cluster,” on page 143. 


Consider the following caveats for the three proxy user options: 


+ “OES Common Proxy User” on page 49 
+ “LDAP Admin User” on page 50 


+ “Another Administrator User” on page 50 


OES Common Proxy User 


If you specify the OES Common Proxy user for a cluster and later disable the Common Proxy user 
feature in eDirectory, the LDAP Admin user is automatically assigned to the 
<cluster_ name> _MGT_GRP.<context> group, and the OES Common Proxy user is automatically 
removed from the group. 


If an OES Common Proxy User is renamed, moved, or deleted in eDirectory, eDirectory takes care of 
the changes needed to modify the user information in the <cluster_name> MGT_GRP.<context> 
group. 


If a cluster node is removed from the tree, the OES Common Proxy User for that server is one of the 
cluster objects that needs to be deleted from eDirectory. 


For information about enabling or disabling the OES Common Proxy User, see the OES 11 SP3: 
Installation Guide. For caveats and troubleshooting information for the OES Common Proxy user, see 
the OES 11 SP3: Planning and Implementation Guide. 
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LDAP Admin User 


If you specify the LDAP Admin user as the NCS Proxy User, you typically continue using this identity 
while you set up the cluster and cluster resources. After the cluster configuration is completed, you 
create another user identity to use for NCS Proxy User, and grant that user sufficient administrator 
rights as specified in “Cluster Administrator or Administrator-Equivalent User” on page 50. 


Another Administrator User 


You can specify an existing user name and password to use for the NCS Proxy User. Novell Cluster 
Services adds this user name to the <cluster_name>_MGT_GRP .<context> group. 


Cluster Administrator or Administrator-Equivalent User 


After the install, you can add other users (such as the tree administrator) as administrator equivalent 
accounts for the cluster by configuring the following for the user account: 


+ Give the user the Supervisor right to the Server object of each of the servers in the cluster. 
¢ Linux-enable the user account with Linux User Management (LUM). 


¢ Make the user a member of a LUM-enabled administrator group that is associated with the 
servers in the cluster. 


IP Address Requirements 


O Each server in the cluster must be configured with a unique static IP address. 


O You need additional unique static IP addresses for the cluster and for each cluster resource and 
cluster-enabled pool. 


O All IP addresses used by the master cluster IP address, its cluster servers, and its cluster 
resources must be on the same IP subnet. They do not need to be contiguous addresses. 


Volume ID Requirements 


A volume ID is a value assigned to represent the volume when it is mounted by NCP Server on an 
OES server. The Novell Client accesses a volume by using its volume ID. Volume ID values range 
from 0 to 254. On a single server, volume IDs must be unique for each volume. In a cluster, volume 
IDs must be unique across all nodes in the cluster. 


Unshared volumes are typically assigned low numbers, starting from 2 in ascending order. Volume 
IDs 0 and 1 are reserved. Volume ID 0 is assigned by default to volume SYS. Volume ID 1 is assigned 
by default to volume _ADMIN. 


Cluster-enabled volumes use high volume IDs, starting from 254 in descending order. When you 
cluster-enable a volume, Novell Cluster Services assigns a volume ID in the resource’s load script 
that is unique across all nodes in a cluster. You can modify the resource’s load script to change the 
assigned volume ID, but you must manually ensure that the new value is unique. 


In a Novell Business Continuity Clustering (BCC) cluster, the volume IDs of BCC-enabled clustered 
volumes must be unique across all nodes in every peer cluster. However, clustered volumes in 
different clusters might have the same volume IDs. Duplicate volume IDs can prevent resources from 
going online if the resource is BCC-migrated to a different cluster. When you BCC-enable a volume, 
you must manually edit its load script to ensure that its volume ID is unique across all nodes in every 


OES 11 SP3: Novell Cluster Services for Linux Administration Guide 


4.4 


4.5 


peer cluster. You can use the ncpcon volumes command on each node in every peer cluster to 
identify the volume IDs in use by all mounted volumes. Compare the results for each server to identify 
the clustered volumes that have duplicate volume IDs assigned. Modify the load scripts to manually 
assign unique volume IDs. 


Hardware Requirements 


The following hardware requirements for installing Novell Cluster Services represent the minimum 
hardware configuration. Additional hardware might be necessary depending on how you intend to use 
Novell Cluster Services. 


O A minimum of two Linux servers, and not more than 32 servers in a cluster 
At least 512 MB of additional memory on each server in the cluster 


One non-shared device on each server to be used for the operating system 


Od U 


At least one network card per server in the same IP subnet. 


In addition to Ethernet NICs, Novell Cluster Services supports VLAN on NIC bonding in OES 11 
SP1 (with the latest patches applied) or later. No modifications to scripts are required. You can 
use ethx or vlanx interfaces in any combination for nodes in a cluster. 


In addition, each server must meet the requirements for Novell Open Enterprise Server 11 SP3. See 
“Meeting All Server Software and Hardware Requirements” in the OES 11 SP3: Installation Guide. 


NOTE: Although identical hardware for each cluster server is not required, having servers with the 
same or similar processors and memory can reduce differences in performance between cluster 
nodes and make it easier to manage your cluster. There are fewer variables to consider when 
designing your cluster and failover rules if each cluster node has the same processor and amount of 
memory. 


If you have a Fibre Channel SAN, the host bus adapters (HBAs) for each cluster node should be 
identical and be configured the same way on each node. 


Virtualization Environments 


Xen and KVM virtualization software is included with SUSE Linux Enterprise Server. Novell Cluster 
Services supports using Xen or KVN virtual machine (VM) guest servers as nodes in a cluster. You 
can install Novell Cluster Services on the guest server just as you would a physical server. All 
templates except the Xen and XenLive templates can be used on a VM guest server. For examples, 
see Chapter 15, “Configuring Novell Cluster Services in a Virtualization Environment,” on page 421. 


Novell Cluster Services is supported to run on a host server where it can be used to cluster the virtual 
machine configuration files on Linux POSIX file systems. Only the Xen and XenLive templates are 
supported for use in the XEN host environment. These virtualization templates are general, and can 
be adapted to work for other virtualization environments, such as KVM and VMware. For information 
about setting up Xen and XenLive cluster resources for a virtualization host server, see Section 15.2, 
“Virtual Machines as Cluster Resources,” on page 422. 
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Software Requirements for Cluster Services 


Ensure that your system meets the following software requirements for installing and managing 
Novell Cluster Services: 
¢ Section 4.6.1, “Novell Open Enterprise Server 11 SP3,” on page 52 
¢ Section 4.6.2, “Novell Cluster Services,” on page 52 
¢ Section 4.6.3, “NetIQ eDirectory 8.8 SP8,” on page 52 
¢ Section 4.6.4, “SLP,” on page 56 
¢ Section 4.6.5, “Novell iManager 2.7.7,” on page 57 
¢ Section 4.6.6, “Clusters Plug-in for iManager,” on page 58 
¢ Section 4.6.7, “Storage-Related Plug-Ins for iManager,” on page 59 
¢ Section 4.6.8, “SFCB and CIMOM,” on page 59 
¢ Section 4.6.9, “CASA 1.7,” on page 60 
¢ Section 4.6.10, “Web Browser,” on page 61 


Novell Open Enterprise Server 11 SP3 


Novell Cluster Services 2.2 for Linux supports Novell Open Enterprise Server 11 SP3 running on 64- 
bit SUSE Linux Enterprise Server 11 Service Pack 4 (SP4). Novell Cluster Services is one of the OES 
Services patterns. 


We recommend having uniform nodes in the cluster. The same release version of OES must be 
installed and running on each node in the cluster. 


Mixed-mode clusters with different operating system platforms are supported during rolling cluster 
upgrades or conversions for the following scenarios: 


Upgrading from See: 
OES 2 SP2 or SP3 Chapter 7, “Upgrading Clusters from OES 2 SP3 to OES 11 SPx,” on page 105 
NetWare 6.5 SP8 OES 11 SP3: Novell Cluster Services NetWare to Linux Conversion Guide 


Novell Cluster Services 


Novell Cluster Services is required for creating and managing clusters and shared resources on your 
OES 11 SP3 servers. Novell Cluster Services is one of the OES Services patterns on the OES 11 
SP3 Add-On DVD. 


NetIQ eDirectory 8.8 SP8 


NetIQ eDirectory 8.8 SP8 is required for managing the Cluster object and Cluster Node objects for 
Novell Cluster Services. eDirectory must be installed and running in the same tree where you create 
the cluster. eDirectory can be installed on any node in the cluster, on a separate server, or ina 
separate cluster. You can install an eDirectory master replica or replica in the cluster, but it is not 
required to do so for Novell Cluster Services. 


For information about using eDirectory, see NetIQ eDirectory 8.8 SP8 Administration Guide. 
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IMPORTANT: Because the cluster objects and their settings are stored in eDirectory, eDirectory must 
be running and working properly whenever you modify the settings for the cluster or the cluster 
resources. 


In addition, ensure that your eDirectory configuration meets the following requirements: 


+ “eDirectory Tree” on page 53 

+ “eDirectory Context” on page 53 

+ “Cluster Object Container” on page 54 

¢ “Cluster Objects Stored in eDirectory” on page 55 
+ “LDAP Server List” on page 56 


eDirectory Tree 


All servers in the cluster must be in the same eDirectory tree. 


eDirectory Context 
If you are creating a new cluster, the eDirectory context where the new Cluster object will reside must 


be an existing context. Specifying a new context during the Novell Cluster Services configuration 
does not create a new context. 
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Cluster Object Container 


We recommend that the Cluster object and all of its member Server objects and Storage objects be 
located in the same OU context. Multiple Cluster objects can co-exist in the same eDirectory 
container. In iManager, use Directory Administration > Create Object to create a container for the 
cluster before you configure the cluster. 


For example, Figure 4-2 shows an example where all clusters are configured in the ncs 
organizational unit. Within the container, each cluster is in its own organizational unit, and the Server 
objects for the nodes are in the same container as the Cluster object: 


Figure 4-2 Same Container for Cluster Object and Server Objects 
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If the servers in the cluster are in separate eDirectory containers, the user that administers the cluster 
must have rights to the cluster server containers and to the containers where any cluster-enabled 
pool objects are stored. You can do this by adding trustee assignments for the cluster administrator to 
a parent container of the containers where the cluster server objects reside. See “eDirectory Rights” 
in the NetiQ eDirectory 8.8 SP8 Administration Guide for more information. 


Renaming a pool involves changing information in the Pool object in eDirectory. If Server objects for 
the cluster nodes are in different containers, you must ensure that the shared pool is active ona 
cluster node that has its NCP server object in the same context as the Pool object of the pool you are 
going to rename. For information about renaming a shared pool, see Section 12.12, “Renaming a 
Clustered NSS Pool,” on page 271. 
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Cluster Objects Stored in eDirectory 


Table 4-1 shows the cluster objects that are automatically created and stored in eDirectory under the 


Cluster object È’) after you create a cluster: 


Table 4-1 Cluster Objects 


Icon eDirectory Object 


& Master_IP_Address_Resource 
P Cluster Node object (servername) 
Ta Resource Template objects. There are 11 default templates: 


AV_Template 
DHCP_Template 
DNS_Template 
Generic_FS_Template 
Generic_IP_Service 
iFolder_Template 
iPrint_Template 
MySQL_Template 
Samba_Template 
Xen_Template 
XenLive_Template 


For example, Figure 4-3 shows the 13 default eDirectory objects that are created in the Cluster 


container as viewed from the Tree view in iManager: 


Figure 4-3 Tree View of the Default eDirectory Objects in the Cluster 
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Table 4-2 shows the cluster objects that are added to eDirectory when you add nodes or create 
cluster resources: 


Table 4-2 Cluster Resource Objects 


Icon eDirectory Object 

P Cluster Node object (servername) 

HP NSS Pool Resource object (p0oo/name_SERVER) 
a Resource object 


Table 4-3 shows the cluster objects that are added to eDirectory when you add nodes or create 
cluster resources in a Novell Business Continuity Cluster, which is made up of Novell Cluster 
Services clusters: 


Table 4-3 BCC Cluster Resource Objects 


Icon eDirectory Object 

2 BCC NSS Pool Resource object 
H BCC Resource Template object 
A BCC Resource object 


LDAP Server List 


If eDirectory is not installed on a node, it looks to the LDAP server list for information about which 
LDAP server to use. As a best practice, you should list the LDAP servers in the following order: 


+ Local to the cluster 


¢ Closest physical read/write replica 


For information about configuring a list of LDAP servers for the cluster, see Section 8.13.1, “Changing 
the Administrator Credentials or LDAP Server IP Addresses for a Cluster,” on page 143. 


SLP 


SLP (Service Location Protocol) is a required component for Novell Cluster Services on Linux when 
you are using NCP to access file systems on cluster resources. NCP requires SLP for the ncpcon 
bind and ncpcon unbind commands in the cluster load and unload scripts. For example, NCP is 
needed for NSS volumes and for NCP volumes on Linux POSIX file systems. 


SLP is not automatically installed when you select Novell Cluster Services. SLP is installed as part of 
the eDirectory configuration during the OES 11 SP3 installation. You can enable and configure SLP 
on the eDirectory Configuration - NTP & SLP page. For information, see “Specifying SLP 
Configuration Options” in the OES 11 SP3: Installation Guide. 


When the SLP daemon (s1pd) is not installed and running on a cluster node, any cluster resource 
that contains the ncpcon bind command goes comatose when it is migrated or failed over to the 
node because the bind cannot be executed without SLP. 
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The SLP daemon (slpd) must also be installed and running on all nodes in the cluster when you 
manage the cluster or cluster resources. 


NCP Server re-registers cluster resource virtual NCP servers with SLP based on the setting for the 
eDirectory advertise-life-time (n4u.nds.advertise-life-time) parameter. The parameter is set by 
default to 3600 seconds (1 hour) and has a valid range of 1 to 65535 seconds. 


You can use the ndsconfig set command to set the n44.nds.advertise-life-time parameter. To 
reset the parameter in a cluster, perform the following tasks on each node of the cluster: 


1 Log in to the node as the root user, then open a terminal console. 


2 Take offline all of the cluster resources on the node, or cluster migrate them to a different server. 
At a command prompt, enter 


cluster offline <resource_name> 
or 


cluster migrate <resource name> <target_node_name> 


3 Modify the eDirectory SLP advertising timer parameter (n4u.nds.advertise-life-time), then 
restart ndsd and slpd. At a command prompt, enter 


ndsconfig set n4u.nds.advertise-life-time=<value_in_seconds> 
rendsd restart 


rceslpd restart 


4 Bring online all of the cluster resources on the node, or cluster migrate the previously migrated 
resources back to this node. 


cluster online <resource_name> 
or 


cluster migrate <resource_ name> <node _name> 
5 Repeat the previous steps on the other nodes in the cluster. 


OpenSLP stores the registration information in cache. You can configure the SLP Directory Agents to 
preserve a copy of the database when the SLP daemon (s1pd) is stopped or restarted. This allows 
SLP to know about registrations immediately when it starts. 


For more information about configuring and managing SLP, see “Configuring OpenSLP for 
eDirectory” in the NetIQ eDirectory 8.8 SP8 Administration Guide. 


Novell iManager 2.7.7 


Novell iManager 2.7.7 is required for configuring and managing clusters on OES 11 SP3. This is a 
Novell-skinned version of NetIQ iManager 2.7.7. 


iManager must be installed on at least one computer in the same tree as the cluster. It can be 
installed in the cluster or not in the cluster. For information about using iManager, see the iManager 
documentation website (http:/Awww.netigq.com/documentation/imanager/index.html). 


For SFCB (Small Footprint CIM Broker) and CIMOM requirements, see Section 4.6.8, “SFCB and 
CIMOM,” on page 59. 


For browser configuration requirements, see “Web Browser” on page 61. 
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4.6.6 Clusters Plug-in for iManager 


The Clusters plug-in for iManager provides the Clusters role where you can manage clusters and 
cluster resources with Novell Cluster Services. The plug-in can be used on all operating systems 
supported by iManager and iManager Workstation. 


The following components must be installed in iManager: 


¢ Clusters (ncsmgmt . rpm) 


+ Common code for storage-related plug-ins (storagemgmt . rpm) 


See “Storage-Related Plug-Ins for iManager” on page 59. 


If iManager is also installed on the server, these files are automatically installed in iManager when 
you install Novell Cluster Services. 


The Clusters plug-in also provides an integrated management interface for Novell Business 
Continuity Clustering (BCC). The additional interface is present only if BCC is installed on the server. 
See the following table for information about the versions of BCC that are supported. BCC is sold 
separately from OES. For purchasing information, see the BCC product page (http://www.novell.com/ 
products/businesscontinuity/). 


BCC Release 


BCC 2.0 


OES Support 


OES 11 SP1 


iManager and Clusters Plug-In 


Novell iManager 2.7.6 or later 


Requires the Clusters plug-in for OES 11 SP1 with the 
latest patches applied. 


See the BCC 2.0 Administration Guide for OES 11 SP1 
(http://www.novell.com/documentation/bcc/ 
bcec20_admin_lx/data/bookinfo.html). 


BCC 1.2.2 


OES 2 SP3 


Novell iManager 2.7.4 or later 


Requires the Clusters plug-in for OES 2 SP3 and the 
OES 2 SP3 April 2011 Scheduled Maintenance patch. 


See the BCC 1.2.2: Administration Guide for OES 2 SP3 
(http://www.novell.com/documentation/bcc/ 
bec122_admin_Ix/data/bookinfo.html). 


BCC 1.2.1 


OES 2 SP2 


Novell iManager 2.7.3 or later 


Requires the Clusters plug-in in the OES 2 SP2 January 
2010 Maintenance patch. 


See the BCC 1.2.1: Administration Guide for OES 2 SP2 
(http://www.novell.com/documentation/bcc/ 
bec121_admin_Ix/data/bookinfo.html). 


BCC 1.1 SP2 


NetWare 6.5 SP8 


Novell iManager 2.7.2 or later 


Requires the Clusters plug-in released in OES 2 SP1 
Linux or NetWare 6.5 SP8, or a later version. 


See the BCC 1.1 SP2 Administration Guide for NetWare 
6.5 SP8 (http:/Awww.novell.com/documentation/bcc/ 
bcec11_admin_nw/data/bktitle.html). 
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Storage-Related Plug-Ins for iManager 


In OES 11 and later, the following storage-related plug-ins for Novell iManager share code in common 
in the storagemgmt . rpm file: 


Product Plug-In NPM File 
Novell Apple Filing Protocol (AFP) File Protocols > AFP afpmgmt .rpm 
Novell Archive and Version Services Archive Versioning arkmgmt . rpm 
Novell CIFS File Protocols > CIFS cifsmgmt . rpm 
Novell Cluster Services Clusters ncsmgmt . rpm 
Novell Distributed File Services Distributed File Services dfsmgmt . rpm 
Novell Storage Services Storage nssmgmt . rpm 


These additional plug-ins are needed when working with the NSS file system. Ensure that you include 
the common storagemgmt . rpm plug-in module when installing any of these storage-related plug-ins. 


IMPORTANT: If you use more than one of these plug-ins, you should install, update, or remove them 
all at the same time to ensure that the common code works for all plug-ins. 


Ensure that you uninstall the old version of the plug-ins before you attempt to install the new versions 
of the plug-in files. 


The plug-in files are included on the installation disk. The latest Novell storage-related plug-ins can 
be downloaded as a single zipped download file from the Novell Downloads website (http:// 
download.novell.com). For information about installing plug-ins in iManager, see “Downloading and 
Installing Plug-in Modules” in the NetlQ® iManager Administration Guide. 


For information about working with storage-related plug-ins for iManager, see “Understanding 
Storage-Related Plug-Ins” in the OES 11 SP3: NSS File System Administration Guide for Linux. 


SFCB and CIMOM 


The Small Footprint CIM Broker (SFCB) replaces OpenWBEM for CIMOM activities in OES 11 and 
later. SFCB provides the default CIMOM and CIM clients. When you install any OES components that 
depend on WBEM, SFCEB and all of its corresponding packages are installed with the components. 
See “Small Footprint CIM Broker (SFCB)” in the OES 11 SP3: Planning and Implementation Guide. 


IMPORTANT: SFCB must be running and working properly whenever you modify the settings for the 
cluster or the cluster resources. 


Port 5989 is the default setting for Secure HTTP (HTTPS) communications. If you are using a firewall, 
the port must be opened for CIMOM communications. Ensure that the CIMOM broker daemon is 
listening on port 5989. Log in as the root user on the cluster master node, open a terminal console, 
then enter the following at the command prompt: 


netstat -an |grep -i5989 
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4.6.9 


The Clusters plug-in (and all other storage-related plug-ins) for iManager require CIMOM connections 
for tasks that transmit sensitive information (such as a user name and password) between iManager 
and the admin volume on the OES server that you are managing. Typically, CIMOM is running, so 
this should be the normal condition when using the server. CIMOM connections use Secure HTTP 
(HTTPS) for transferring data, and this ensures that sensitive data is not exposed. 


IMPORTANT: SFCB is automatically PAM-enabled for Linux User Management (LUM) as part of the 
OES installation. Users not enabled for LUM cannot use the CIM providers to manage OES. The user 
name that you use to log in to Novell iManager when you manage a cluster and the BCC cluster must 
be an eDirectory user name that has been LUM-enabled. 


For more information about the permissions and rights needed by the administrator user, see 
Section 4.1, “Cluster Administration Requirements,” on page 47. 


If CIMOM is not currently running when you click OK or Finish for the task that sends the sensitive 
information, you get an error message explaining that the connection is not secure and that CIMOM 
must be running before you can perform the task. 


IMPORTANT: If you receive file protocol errors, it might be because SFCB is not running. 


You can use the rcsf£cb command to help resolve CIMOM and SFCB issues: 


To perform this task At a command prompt, enter as the root user 
To start SFCB resfcb start 

To stop SFCB resfcb stop 

To check SFCB status resfcb status 

To restart SFCB resfcb restart 


For more information, see “Web Based Enterprise Management using SFCB” (http://www.suse.com/ 
documentation/sles11/book_sle_admin/data/cha_wbem.html) in the SUSE Linux Enterprise Server 
11 Administration Guide (http:/Avwww.suse.com/documentation/sles11/book_sle_admin/data/ 
book_sle_admin.html). 


CASA 1.7 


Novell Cluster Services requires CASA (Common Authentication Service Adapter) 1.7 or later to be 
installed and running on each node in the cluster. 


The following table contains some useful commands for resolving CASA issues: 


To perform this task At a command prompt, enter as the root user 
To check CASA status remicasad status 

To check that CASA is running correctly CASAcli -1 

To restart CASA remicasad restart 
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Web Browser 


For a information about supported web browsers for Novell iManager, see “Using a Supported Web 
Browser” in the NetIQ® iManager Administration Guide. 


The Clusters plug-in for iManager might not operate properly if the highest priority Language setting 
for your web browser is set to a language other than one of the supported languages in iManager. To 
view a list of supported languages and codes in iManager, select the Preferences tab, click 
Language. The language codes are Unicode (UTF-8) compliant. 


To avoid display problems, in your web browser, select Tools > Options > Languages, and then set 
the first language preference in the list to a supported language. You must also ensure the Character 
Encoding setting for the browser is set to Unicode (UTF-8) or ISO 8859-1 (Western, Western 
European, West European). 


¢ In a Mozilla browser, select View > Character Encoding, then select the supported character 
encoding setting. 


¢ In an Internet Explorer browser, select View > Encoding, then select the supported character 
encoding setting. 


Software Requirements for Cluster Resources 


Ensure that your system meets the following software requirements for creating and managing 
storage cluster resources: 
¢ Section 4.7.1, “NCP Server for Linux,” on page 61 
¢ Section 4.7.2, “Novell Storage Services File System for Linux,” on page 62 
¢ Section 4.7.3, “LVM Volume Groups and Linux POSIX File Systems,” on page 63 
¢ Section 4.7.4, “NCP Volumes on Linux POSIX File Systems,” on page 63 
¢ Section 4.7.5, “Dynamic Storage Technology Shadow Volume Pairs,” on page 63 
+ Section 4.7.6, “NCP File Access,” on page 63 
¢ Section 4.7.7, “Novell AFP,” on page 63 
¢ Section 4.7.8, “Novell CIFS,” on page 64 
¢ Section 4.7.9, “Novell Samba,” on page 64 
¢ Section 4.7.10, “Novell Domain Services for Windows,” on page 64 


NCP Server for Linux 


NCP Server for Linux is required in order to create virtual server names (NCS:NCP Server objects) for 
cluster resources. This includes storage and service cluster resources. To install NCP Server, select 
the NCP Server and Dynamic Storage Technology option during the install. 


NCP Server for Linux also allows you to provide authenticated access to data by using the Novell 
Trustee model. The NCP Server component must be installed and running before you can cluster- 
enable the following storage resources: 


Ħ NSS pools and volumes 


+ NCP volumes on Linux POSIX file systems 
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+ Dynamic Storage Technology shadow volume composed of a pair of NSS volumes 


¢ Linux Logical Volume Manager volume groups that use an NCS:NCP Server object, such as 
those created by using the Novell Logical Volume Manger (NLVM) commands or the NSS 
Management Utility (NSSMU) 


WARNING: Cross-protocol file locking is required when using multiple protocols for data access on 
the same volume. This helps prevent possible data corruption that might occur from cross-protocol 
access to files. The NCP Cross-Protocol File Lock parameter is enabled by default when you install 
NCP Server. If you modify the Cross-Protocol File Lock parameter, you must modify the setting on all 
nodes in the cluster. 


NCP Server does not support cross-protocol locks across a cluster migration or failover of the 
resource. If a file is opened with multiple protocols when the migration or failover begins, the file 
should be closed and reopened after the migration or failover to acquire cross-protocol locks on the 
new node. 


See “Configuring Cross-Protocol File Locks for NCP Server” in the OES 11 SP3: NCP Server for 
Linux Administration Guide. 


NCP Server for Linux is not required when running Novell Cluster Services on a Xen-based virtual 
machine (VM) host server (Dom0) for the purpose of cluster-enabling an LVM volume group that 
holds the configuration files for Xen-based VMs. Users do not directly access these VM files. 


For information about configuring and managing NCP Server for Linux, see the OES 11 SP3: NCP 
Server for Linux Administration Guide. 


For information about creating and cluster-enabling NCP volumes on Linux POSIX file systems, see 
“Configuring NCP Volumes with Novell Cluster Services” in the OES 11 SP3: NCP Server for Linux 
Administration Guide. 


4.7.2 Novell Storage Services File System for Linux 


Novell Storage Services (NSS) file system on Linux provides the following capabilities used by Novell 
Cluster Services: 


¢ Intializing and sharing devices used for the SBD (split-brain detector) and for shared pools. See 
Section 4.8.2, “SBD Partitions,” on page 65. 


+ Creating and cluster-enabling a shared pool. See Chapter 12, “Configuring and Managing 
Cluster Resources for Shared NSS Pools and Volumes,” on page 237. 


¢ Creating and cluster-enabling a shared Linux Logical Volume Manager (LVM) volume group. 
See Chapter 13, “Configuring and Managing Cluster Resources for Shared LVM Volume 
Groups,” on page 327. 


The NSS pool configuration and NCS pool cluster resource configuration provide integrated 
configuration options for the following advertising protocols: 


+ NetWare Core Protocol (NCP), which is selected by default and is mandatory for NSS. See 
“NCP Server for Linux” on page 61. 
+ Novell Apple Filing Protocol (AFP). See “Novell AFP” on page 63. 


+ Novell CIFS. See “Novell CIFS” on page 64. 
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LVM Volume Groups and Linux POSIX File Systems 


Novell Cluster Services supports creating shared cluster resources on Linux Logical Volume Manager 
(LVM) volume groups. You can configure Linux POSIX file systems on the LVM volume group, such 
as Ext3, XFS, and ReiserFS. LVM and Linux POSIX file systems are automatically installed as part of 
the OES installation. 


After the cluster is configured, you can create LVM volume group cluster resources as described in 
Chapter 13, “Configuring and Managing Cluster Resources for Shared LVM Volume Groups,” on 
page 327. 


NCP Server is required if you want to create a virtual server name (NCS :NCP Server object) for the 
cluster resource. You can add an NCP volume (an NCP share) on the Linux POSIX file system to give 
users NCP access to the data. See Section 4.7.1, “NCP Server for Linux,” on page 61. 


NCP Volumes on Linux POSIX File Systems 


After you cluster-enable an LVM volume group, Novell Cluster Services supports creating NCP 
volumes on the volume group’s Linux POSIX file systems. NCP Server is required. See Section 4.7.1, 
“NCP Server for Linux,” on page 61. 


For information about creating and cluster-enabling NCP volumes, see “Configuring NCP Volumes 
with Novell Cluster Services” in the OES 11 SP3: NCP Server for Linux Administration Guide. 


Dynamic Storage Technology Shadow Volume Pairs 


Novell Cluster Services supports clustering for Novell Dynamic Storage Technology (DST) shadow 
volume pairs on OES 11 and later. DST is installed automatically when you install NCP Server for 
Linux. To use cluster-enabled DST volume pairs, select the NCP Server and Dynamic Storage 
Technology option during the install. 


For information about creating and cluster-enabling Dynamic Storage Technology volumes on Linux, 
see “Configuring DST Shadow Volume Pairs with Novell Cluster Services” in the OES 11 SP3: 
Dynamic Storage Technology Administration Guide. 


NCP File Access 


Novell Cluster Services requires NCP file access to be enabled for cluster-enabled NSS volumes, 
NCP volumes, and DST volumes, even if users do not access files via NCP. This is required to 
support access control via the Novell Trustee model. See Section 4.7.1, “NCP Server for Linux,” on 
page 61. 


Novell AFP 


Novell Cluster Services supports using Novell AFP as an advertising protocol for cluster-enabled 
NSS pools and volumes. 


Novell AFP is not required to be installed when you install Novell Cluster Services, but it must be 
installed and running before you enable AFP as an advertising protocol for an NSS pool cluster 
resource. Otherwise, the resource will be in a comatose state, and cannot be brought online. The 
AFP daemon should also be running before you bring resources online that have AFP enabled. 
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To install Novell AFP, select the Novell AFP option from the OES Services list during the install. For 
information about configuring and managing the Novell AFP service, see the OES 11 SP3: Novell 
AFP for Linux Administration Guide. 


Novell CIFS 


Novell Cluster Services supports using Novell CIFS as an advertising protocol for cluster-enabled 
NSS pools and volumes. 


Novell CIFS is not required to be installed when you install Novell Cluster Services, but it must be 
installed and running in order for the CIFS Virtual Server Name field and the CIFS check box to be 
available. Select the check box to enable Novell CIFS as an advertising protocol for the NSS pool 
cluster resource. A default CIFS Virtual Server Name is suggested, but you can modify it. The CIFS 
daemon should also be running before you bring resources online that have CIFS enabled. 


To install Novell CIFS, select the Novell CIFS option from the OES Services list during the install. For 
information about configuring and managing the Novell CIFS service, see the OES 11 SP3: Novell 
CIFS for Linux Administration Guide. 


Novell Samba 


Novell Cluster Services supports using Novell Samba as an alternative to using Novell CIFS. It 
provides SMB/CIFS access for users. Users must be enabled with Linux User Management. 


Samba is not integrated as an advertising protocol option for NSS pool cluster resources. 


For information about configuring and managing Novell Samba, see the following sections in the OES 
11 SP3: Novell Samba Administration Guide: 

¢ “Configuring Samba for LVM Volume Groups and Novell Cluster Services” 

+ “Configuring Samba for NSS Pools and Novell Cluster Services” 


Novell Domain Services for Windows 


Novell Cluster Services supports using clusters in Domain Services for Windows (DSfW) contexts. If 
Domain Services for Windows is installed in the eDirectory tree, the nodes in a given cluster can be in 
the same or different DSfW subdomains. Port 1636 is used for DSfW communications. This port must 
be opened in the firewall. 


For information using Domain Services for Windows, see the OES 11 SP3: Domain Services for 
Windows Administration Guide. 


Shared Disk Configuration Requirements 


A shared disk subsystem is required for a cluster in order to make data highly available. The Novell 
Cluster Services software must be installed in order to be able to mark devices as shareable, such as 
the devices you use for clustered pools and the device you use for the SBD (split-brain detector) 
during the cluster configuration. 


Ensure that your shared storage devices meet the following requirements: 


¢ Section 4.8.1, “Shared Devices,” on page 65 
¢ Section 4.8.2, “SBD Partitions,” on page 65 
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¢ Section 4.8.3, “Shared iSCSI Devices,” on page 67 
¢ Section 4.8.4, “Shared RAID Devices,” on page 67 


Shared Devices 


Novell Cluster Services supports the following shared disks: 


¢ Fibre Channel LUN (logical unit number) devices in a storage array 
¢ iSCSI LUN devices 
¢ SCSI disks (shared external drive arrays) 


Before configuring Novell Cluster Services, the shared disk system must be properly set up and 
functional according to the manufacturer's instructions. 


Prior to installation, verify that all the drives in your shared disk system are recognized by Linux by 
viewing a list of the devices on each server that you intend to add to your cluster. If any of the drives 
in the shared disk system do not show up in the list, consult the OES 11 SP3 documentation or the 
shared disk system documentation for troubleshooting information. 


Prepare the device for use in a cluster resource: 


+ NSS Pool: For new devices, you must initialize and share the device before creating the pool. 
For an existing pool that you want to cluster-enable, use NSSMU or iManager to share the 
device. 


All devices that contribute space to a clustered pool must be able to fail over with the pool cluster 
resource. You must use the device exclusively for the clustered pool; do not use space on it for 
other pools or for Linux volumes. A device must be marked as Shareable for Clustering before 
you can use it to create or expand a clustered pool. 


+ Linux LVM volume group: For new devices, use an unpartitioned device that has been 
initialized. Do not mark the device as shared because doing so creates a small partition on it. 
LVM uses the entire device for the volume group. For an existing volume group, no not mark the 
device as shared. 


If this is a new cluster, connect the shared disk system to the first server so that the SBD cluster 
partition can be created during the Novell Cluster Services install. See Section 4.8.2, “SBD 
Partitions,” on page 65. 


SBD Partitions 


If your cluster uses physically shared storage resources, you must create an SBD (split-brain 
detector) partition for the cluster. You can create an SBD partition in YaST as part of the first node 
setup, or by using the SBD Utility (sbdutil) before you add a second node to the cluster. Both the 
YaST new cluster setup and the SBD Utility (sbduti1) support mirroring the SBD partition. 


An SBD must be created before you attempt to create storage objects like pools or volumes for file 
system cluster resources, and before you configure a second node in the cluster. NLVM and other 
NSS management tools need the SBD to detect if a node is a member of the cluster and to get 
exclusive locks on physically shared storage. 
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For information about how SBD partitions work and how to create an SBD partition for an existing 
cluster, see Section 9.18, “Creating or Deleting Cluster SBD Partitions,” on page 173. 

+ “Preparing the SAN Devices for the SBD” on page 66 

¢ “Initializing and Sharing a Device for the SBD” on page 66 

+ “Determining the SBD Partition Size” on page 66 


Preparing the SAN Devices for the SBD 


Use the SAN storage array software to carve a LUN to use exclusively for the SBD partition. The 
device should have at least 20 MB of free available space. The minimum size is 8 MB. Connect the 
LUN device to all nodes in the cluster. 


For device fault tolerance, you can mirror the SBD partition by specifying two devices when you 
create the SBD. Use the SAN storage array software to carve a second LUN of the same size to use 
as the mirror. Connect the LUN device to all nodes in the cluster. 


The device you use to create the SBD partition must not be a software RAID device. You can use a 
hardware RAID configured in a SAN array since it is seen as a regular device by the server. 


Initializing and Sharing a Device for the SBD 


Before you use YaST to set up the a cluster, you must initialize each SAN device that you created for 
the SBD, and mark each as Shareable for Clustering. 


IMPORTANT: The Novell Cluster Services software must already be installed in order to be able to 
mark the devices as shareable. 


After you install Novell Cluster Services, but before you configure the cluster, you can initialize a 
device and set it to a shared state by using NSSMU, the Storage plug-in for iManager, Novell Linux 
Volume Manager (NLVM) commands, or an NSS utility called nesinit. 


If you configure a cluster before you create an SBD, NSS tools cannot detect if the node is a member 
of the cluster and cannot get exclusive locks to the physically shared storage. In this state, you must 
use the -s NLVM option with the nlvm init command to override the shared locking requirement 
and force NLVM to execute the command. To minimize the risk of possible corruption, you are 
responsible for ensuring that you have exclusive access to the shared storage at this time. 


When you mark the device as Shareable for Clustering, share information is added to the disk ina 
free-space partition that is about 4 MB in size. This space becomes part of the SBD partition. 


Determining the SBD Partition Size 


When you configure a new cluster, you can specify how much free space to use for the SBD, or you 
can specify the Use Maximum Size option to use the entire device. If you specify a second device to 
use as a mirror for the SBD, the same amount of space is used. If you specify to use the maximum 
size and the mirror device is bigger than the SBD device, you will not be able to use the excess free 
space on the mirror for other purposes. 


Because an SBD partition ends on a cylinder boundary, the partition size might be slightly smaller 
than the size you specify. When you use an entire device for the SBD partition, you can use the Use 
Maximum Size option, and let the software determine the size of the partition. 
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4.8.3 Shared iSCSI Devices 


If you are using iSCSI for shared disk system access, ensure that you have installed and configured 
the iSCSI initiators and targets (LUNs) and that they are working properly. The iSCSI target devices 
must be mounted on the server before the cluster resources are brought online. 


48.4 Shared RAID Devices 


We recommend that you use hardware RAID in the shared disk subsystem to add fault tolerance to 
the shared disk system. 


Consider the following when using software RAIDs: 


+ NSS software RAID is supported for shared disks for NSS pools. Any RAIDO/5 device that is 
used for a clustered pool must contribute space exclusively to that pool; it cannot be used for 
other pools. This allows the device to fail over between nodes with the pool cluster resource. 
Ensure that its component devices are marked as Shareable for Clustering before you use a 
RAIDO/5 device to create or expand a clustered pool 


¢ Linux software RAID can be used in shared disk configurations that do not require the RAID to 
be concurrently active on multiple nodes. Linux software RAID cannot be used underneath 
clustered file systems (Such as OCFS2, GFS, and CXFS) because Novell Cluster Services does 
not support concurrent activation. 


WARNING: Activating Linux software RAID devices concurrently on multiple nodes can result in 
data corruption or inconsistencies. 


4.9 SAN Rules for LUN Masking 


When you create a Novell Cluster Services system that uses shared storage space, it is important to 
remember that all of the servers that you grant access to the shared device, whether in the cluster or 
not, have access to all of the volumes on the shared storage space unless you specifically prevent 
such access. Novell Cluster Services arbitrates access to shared volumes for all cluster nodes, but 
cannot protect shared volumes from being corrupted by non-cluster servers. 


LUN masking is the ability to exclusively assign each LUN to one or more host connections. With it 
you can assign appropriately sized pieces of storage from a common storage pool to various servers. 
See your storage system vendor documentation for more information on configuring LUN masking. 


Software included with your storage system can be used to mask LUNs or to provide zoning 
configuration of the SAN fabric to prevent shared volumes from being corrupted by non-cluster 
servers. 


IMPORTANT: We recommend that you implement LUN masking in your cluster for data protection. 
LUN masking is provided by your storage system vendor. 
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Multipath I/O Configuration Requirements 


If you use shared devices with multipath I/O capability, ensure that your setup meets the 
requirements in this section. 
¢ Section 4.10.1, “Path Failover Settings for Device Mapper Multipath,” on page 68 
¢ Section 4.10.2, “Modifying the Port Down Retry Setting in the modprobe.conf.local File,” on 
page 68 
¢ Section 4.10.3, “Modifying the Polling Interval, No Path Retry, and Failback Settings in the 
multipath.conf File,” on page 69 


¢ Section 4.10.4, “Modifying the Port Down Retry and Link Down Retry Settings for an HBA BIOS,” 
on page 70 


Path Failover Settings for Device Mapper Multipath 


When you use Device Mapper Multipath (DM-MP) with Novell Cluster Services, ensure that you set 
the path failover settings so that the paths fail when path I/O errors occur. 


The default setting in DM-MP is to queue I/O if one or more HBA paths is lost. Novell Cluster Services 
does not migrate resources from a node set to the Queue mode because of data corruption issues 
that can be caused by double mounts if the HBA path is recovered before a reboot. 


IMPORTANT: The HBAs must be set to Failed mode so that Novell Cluster Services can 
automatically fail over storage resources if a disk paths go down. 


Change the Retry setting in the /etc/modprobe.conf.local and /etc/multipath.conf files so 
that DM-MP works correctly with Novell Cluster Services. See Section 4.10.2, “Modifying the Port 
Down Retry Setting in the modprobe.conf.local File,” on page 68 and Section 4.10.3, “Modifying the 
Polling Interval, No Path Retry, and Failback Settings in the multipath.conf File,” on page 69. 


Also consider changes as needed for the retry settings in the HBA BIOS. See Section 4.10.4, 
“Modifying the Port Down Retry and Link Down Retry Settings for an HBA BIOS,” on page 70. 


Modifying the Port Down Retry Setting in the 
modprobe.conf.local File 


The port_down_retry setting specifies the number of times to attempt to reconnect to a port if it is 
down when using multipath I/O in a cluster. Ensure that you have installed the latest HBA drivers from 
your HBA vendor. Refer to the HBA vendor’s documentation to understand the preferred settings for 
the device, then make any changes in the /etc/modprobe. conf .1local file. 


For example, for QLogic HBAs, ensure that you have installed the latest gla-driver. The following 
settings are suggested for the /etc/modprobe. conf .1local file. Ensure that you verify the vendor's 
preferred settings before making the changes. 


options gqla2xxx qlport_down_retry=2 
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4.10.3 


Modifying the Polling Interval, No Path Retry, and Failback 
Settings in the multipath.conf File 


The goal of multipath I/O is to provide connectivity fault tolerance between the storage system and 
the server. When you configure multipath I/O for a stand-alone server, the retry setting protects the 
server operating system from receiving I/O errors as long as possible. It queues messages until a 
multipath failover occurs and provides a healthy connection. However, when connectivity errors occur 
for a cluster node, you want to report the I/O failure in order to trigger the resource failover instead of 
waiting for a multipath failover to be resolved. In cluster environments, you must modify the retry 
setting so that the cluster node receives an I/O error in relation to the cluster SBD verification process 
(recommended to be 50% of the heartbeat tolerance) if the connection is lost to the storage system. 
In addition, you want the multipath I/O fail back to be set to manual in order to avoid a ping-pong of 
resources because of path failures. 


Use the guidance in the following sections to configure the polling interval, no path retry and failback 
settings in the /etc/multipath.conf file: 

+ “Polling Interval” on page 69 

+ “No Path Retry” on page 69 

+ “Failback” on page 69 

+ “Example of Multipath I/O Settings” on page 70 


Polling Interval 


The polling interval for multipath I/O defines the interval of time in seconds between the end of one 
path checking cycle and the beginning of the next path checking cycle. The default interval is 5 
seconds. An SBD partition has I/O every 4 seconds by default. A multipath check for the SBD 
partition is more useful if the multipath polling interval value is 4 seconds or less. 


IMPORTANT: Ensure that you verify the polling interval setting with your storage system 
vendor. Different storage systems can require different settings. 


No Path Retry 


We recommend a retry setting of “fail” or “0” in the /etc/multipath. conf file when working ina 
cluster. This causes the resources to fail over when the connection is lost to storage. Otherwise, the 
messages queue and the resource failover cannot occur. 


IMPORTANT: Ensure that you verify the retry settings with your storage system vendor. Different 
storage systems can require different settings. 


features "0" 
no path_retry fail 


The value fail is the same as a Setting value of 0. 


Failback 


We recommend a failback setting of "manual" for multipath I/O in cluster environments in order to 
prevent multipath failover ping-pong. 


failback "manual" 
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4.10.4 


IMPORTANT: Ensure that you verify the failback setting with your storage system vendor. Different 
storage systems can require different settings. 


Example of Multipath I/O Settings 


For example, the following code shows the default polling interval, no path_retry, and 
failback commands as they appear in the /etc/multipath.conf file for EMC storage: 


defaults 
polling interval 5 

# no_path_retry 0 
user friendly names yes 


features 0 


devices { 
device { 
vendor "DGC" 
product ".*" 
product_blacklist "LUNZ" 
path_grouping policy "group_by prio" 
path_checker "emc_clariion" 
features "0" 
hardware_handler "1 emc" 
prio "emc" 
failback "manual" 
no_path_retry fail #Set MP for failed I/O mode, any other non-zero values sets the HBAs for 
Blocked I/O mode 


} 


For information about configuring the multipath.cont file, see “Managing Multipath I/O for Devices” 
(http:/Awww.suse.com/documentation/sles11/stor_admin/data/multipathing.html) in the SLES 11 
Storage Administration Guide (http:/www.suse.com/documentation/sles11/stor_admin/data/ 
bookinfo.html). 


Modifying the Port Down Retry and Link Down Retry 
Settings for an HBA BIOS 


In the HBA BIOS, the default settings for the Port Down Retry and Link Down Retry values are 
typically set too high for a cluster environment. For example, there might be a delay of more than 30 
seconds after a fault occurs before I/O resumes on the remaining HBAs. Reduce the delay time for 
the HBA retry so that its timing is compatible with the other timeout settings in your cluster. 


For example, you can change the Port Down Retry and Link Down Retry settings to 5 seconds in the 
QLogic HBA BIOS: 


Port Down Retry=5 
Link Down Retry=5 
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5.1 


Installing, Configuring, and Repairing 
Novell Cluster Services 


This section describes how to install the Novell Cluster Services software on Novell Open Enterprise 


Server 11 SP3 servers, how to configure the cluster on the first node, and how to configure other 
nodes for the cluster. 


IMPORTANT: Before you install or configure Novell Cluster Services, ensure that you understand the 


requirements for it and have configured the environment as described in Chapter 4, “Planning for 
Novell Cluster Services,” on page 47. 


See the following resources for information about rolling cluster upgrades or conversions to the lates 
version of Novell Cluster Services: 


t 


Upgrading from See: 

OES 11 SP1 Chapter 6, “Upgrading OES 11 Clusters,” on page 101 

OES 2 SP3 Chapter 7, “Upgrading Clusters from OES 2 SP3 to OES 11 SPx,” on page 105 
NetWare 6.5 SP8 OES 11 SP3: Novell Cluster Services NetWare to Linux Conversion Guide 


¢ Section 5.1, “Novell Cluster Services Licensing,” on page 71 
¢ Section 5.2, “Extending the eDirectory Schema to Add Cluster Objects,” on page 72 


¢ Section 5.3, “Assigning Install Rights for Container Administrators or Non-Administrator Users,” 


on page 74 
¢ Section 5.4, “Installing Novell Cluster Services,” on page 75 
¢ Section 5.5, “Configuring Novell Cluster Services,” on page 79 
¢ Section 5.6, “Configuring Additional Administrators,” on page 92 
¢ Section 5.7, “Installing or Updating the Clusters Plug-in for iManager,” on page 93 
¢ Section 5.8, “Patching Novell Cluster Services,” on page 95 
¢ Section 5.9, “Removing the NCS Configuration Information from a Node,” on page 95 
¢ Section 5.10, “Removing a Node from a Cluster,” on page 97 
¢ Section 5.11, “Adding a Node That Was Previously in the Cluster,” on page 98 
¢ Section 5.12, “What's Next,” on page 99 


Novell Cluster Services Licensing 


Novell Cluster Services supports up to 32 nodes in a single cluster. You receive a Novell Cluster 
Services entitlement that covers an unlimited number of two-node clusters. To add nodes to a two- 
node cluster, you can purchase a paper license for them for an additional fee. For more information, 
see the Novell Cluster Services for Open Enterprise Server How-to-Buy website (http:// 
www.novell.com/products/openenterpriseserver/ncs/howtobuy.html). 
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5.2 


5.2.1 


Extending the eDirectory Schema to Add Cluster 
Objects 


The first time that you install Novell Cluster Services in an eDirectory tree, the directory schema for 
the tree is extended to include the Cluster object container and the following types of objects in it: 


¢ Cluster Node objects 
¢ Cluster Resource objects 
¢ Cluster Template objects 


+ Volume Resource objects 


A tree administrator user with the eDirectory credentials to do so can extend the eDirectory schema 
before a cluster is installed anywhere in a tree. This allows container administrators (or non- 
administrator users) to install a cluster in a container in that same tree without needing full 
administrator rights for the tree. After the schema has been extended, you must assign some 
eDirectory rights to the container administrators (or non-administrator users) who will install Novell 
Cluster Services clusters. 


If the schema is not extended separately, the installer of the first cluster server in the tree must be an 
administrator with credentials to extend the eDirectory schema. The schema is automatically 
extended during the install. Subsequent cluster servers can be installed by container administrators 
(or non-administrator users) with sufficient rights to install Novell Cluster Services. 


IMPORTANT: For information about the eDirectory rights needed to install Novell Cluster Services in 
a tree after the schema has been extended, see Section 5.3, “Assigning Install Rights for Container 
Administrators or Non-Administrator Users,” on page 74. 


See the following sections for information about extending the schema before you install Novell 
Cluster Services in a tree. 


¢ Section 5.2.1, “Prerequisites for Extending the Schema,” on page 72 


¢ Section 5.2.2, “Extending the Schema,” on page 73 


Prerequisites for Extending the Schema 


This procedure assumes that no clusters currently exist in the tree, and the schema needs to be 
extended for cluster objects. 


You need the tree administrator credentials for extending the eDirectory schema. 
You need the following information about the tree where you want to install Novell Cluster Services 
clusters: 


Table 5-1 Tree Information Needed for the Schema Expansion 


Parameter Description Example 


port_num The port number you assigned for eDirectory 636 
communications in the tree where you plan to install 
clusters. The default port is 636. 
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5.2.2 


Parameter Description Example 


admin_username The typeful fully distinguished user name of the cn=admin, o=example 


administrator who has the eDirectory rights needed 
to extend the schema. 


admin_password The password of the administrator user. password 


server_ip_address The IP address of the eDirectory server that 10.10.10.102 


contains the schema files. 


Extending the Schema 


You need to extend the schema only one time in the tree where you will be installing clusters. 


IMPORTANT: It is not necessary to extend the schema separately from the Novell Cluster Services 
installation if the installer of the first cluster server in the tree has the eDirectory rights necessary to 
change the schema, because the schema can be automatically extended during the install. 


To extend the schema before Novell Cluster Services is installed in the tree, the tree administrator 
user can expand the schema as follows: 


1 


As a user with rights to modify the eDirectory schema, log in as the root user, then open a 
terminal console. 


In a text editor, create a text file, specify the configuration information for the Novell Cluster 
Services cluster in it, then save the file. 


The following lines are an example of the content of the file, with sample values. The directives 
are self-explanatory. 


IMPORTANT: Ensure that you change the values inside the quotation marks to the actual 
settings for your cluster. 


CONFIG NCS LDAP TP="10.1.1.102" 
CONFIG NCS LDAP PORT="636" 
CONFIG NCS ADMIN DN="cn=admin.o=context" 
CONFIG NCS ADMIN PASSWORD="password" 


As the root user, enter the following command at a command prompt: 
mkdir -p /var/opt/novell/install 
As the root user, enter the following command at a command prompt: 


/opt/novell/ncs/install/ncs_install.py -e -f configuration filename 


Replace configuration filename With the actual name of the file that you created in Step 2, 
such as 


/opt/novell/ncs/install/ncs_install.py -e -f /root/Desktop/my_schema_info.txt 
Delete the configuration file (configuration _ filename) that you created. 


This file contains a password in clear text. For security reasons, ensure that you delete the file 
when you are done. 


Continue with Section 5.3, “Assigning Install Rights for Container Administrators or Non- 
Administrator Users,” on page 74. 
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5.3 Assigning Install Rights for Container 
Administrators or Non-Administrator Users 


If the eDirectory schema has been extended in the tree where you want to create clusters, the 
container administrator or non-administrator user needs the following eDirectory rights to install and 
configure Novell Cluster Services. These rights are also required if a different user configures Novell 
Cluster Services after the install as described in Section 5.5.3, “Using Different LDAP Credentials for 
the Cluster Configuration,” on page 82. 


¢ Attribute Modify rights on the NCP Server object of each node in the cluster. 


To set the Attribute Modify rights for the user on the nodes’ NCP Server objects: 


1. In iManager, select Rights > Modify Trustees. 


Po wD 


. Select the NCP server object for the node, then click Add Trustee. 


For Entry Rights, set the Browse right. 
For All Attributes Rights, set the Compare, Read, and Write rights. 


. Click Apply to save and apply your changes. 


Repeat Step 1 to Step 5 for the NCP Server object of each server that you plan to add to the 
cluster. 


¢ Object Create rights on the container where the NCP Server objects are. 


To set the Object Create rights for the user on the container where the NCP Server objects are: 


4 
2. 
3. 
4. 
5 


In iManager, select Rights > Modify Trustees. 

Select the Container object, then click Add Trustee. 

For Entry Rights, set the Browse, Create, and Rename rights. 

For All Attributes Rights, set the Compare, Read, and Write rights. 
Click Apply to save and apply your changes. 


¢ Object Create rights where the cluster container will be. 


This step is needed if the container for the Cluster object is different than the container for the 
NCP Server objects. 


To set the Object Create rights for the user on the container where the Cluster objects will be: 


1. In iManager, select Rights > Modify Trustees. 


ok wo DN 


. Select the Container object, then click Add Trustee. 


For Entry Rights, set the Browse, Create, and Rename rights. 
For All Attributes Rights, set the Compare, Read, and Write rights. 


. Click Apply to save and apply your changes. 


For information about eDirectory rights, see “eDirectory Rights” in the NetIQ eDirectory 8.8 SP8 
Administration Guide. 
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5.4 


5.4.1 


Installing Novell Cluster Services 


Novell Cluster Services for Linux is included on the add-on media for OES 11 SP3. It is necessary to 
install OES on every server that you want to add to a cluster. You can have up to 32 nodes in each 
cluster. See Section 5.1, “Novell Cluster Services Licensing,” on page 71. 


Installing Novell Cluster Services does the following: 

¢ If the eDirectory schema has not already been extended for cluster objects in the tree, the 

schema is extended. 

¢ Novell Cluster Services software is installed on the server. 
You can install Novell Cluster Services when you install the OES platform, or you can install it later on 
an existing OES server. 

¢ Section 5.4.1, “Before You Install Novell Cluster Services,” on page 75 

è Section 5.4.2, “Installing Novell Cluster Services during an OES Installation,” on page 76 


¢ Section 5.4.3, “Installing Novell Cluster Services on an Existing OES Server,” on page 78 


Before You Install Novell Cluster Services 


Ensure that your system meets the requirements and guidelines in Chapter 4, “Planning for Novell 
Cluster Services,” on page 47. Before you install Novell Cluster Services, verify that your setup meets 
these requirements: 

+ “Using a Local eDirectory Database” on page 75 

+ “Rights to Extend the Schema” on page 75 

+ “Shared Devices for the SBD” on page 75 

¢ “SBD Required before You Install the Second Node in the Cluster” on page 76 


Using a Local eDirectory Database 


If you want Novell Cluster Services to use a local eDirectory database on the same server, you must 
install and configure eDirectory before you configure Novell Cluster Services. 


Rights to Extend the Schema 


If the eDirectory schema was not previously extended in the tree as described in Section A.3, “OES 
Installation extend_schema Command,” on page 455, the user who installs Novell Cluster Services 
must be an administrator user with the rights to extend the schema, such as the tree administrator. 


Shared Devices for the SBD 


If you have a shared disk system and the server where you are installing Novell Cluster Services is 
the first node in a cluster, install the Novell Cluster Services software, then initialize the device you 
need for the Split Brain Detector (SBD) partition and mark it as shareable. If you plan to mirror the 
SBD, prepare two devices of the same size. You can create the SBD when you configure Novell 
Cluster Services on the first node, or you can use the sbdutil utility to create it before you install 
Novell Cluster Services on a second node in the cluster. 
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SBD Required before You Install the Second Node in the Cluster 


If you have a shared disk system and the server where you are installing Novell Cluster Services is 
the second node in a cluster, verify that a cluster partition for the clusters SBD exists on the first 
cluster node before you begin the install on the second node. 


IMPORTANT: The cluster SBD partition is not required unless you have shared storage. 


Typically, you create the SBD when you configure the cluster on the first node as described in 
Section 5.5.5, “Configuring a New Cluster,” on page 83. A one-node cluster that has shared disk 
storage can be configured without an SBD, but the SBD must be created before you add another 
node. For information about manually creating an SBD, see: 


¢ Section 9.18.3, “Creating a Non-Mirrored Cluster SBD Partition with SBDUTIL,” on page 176 
¢ Section 9.18.5, “Creating a Mirrored Cluster SBD Partition with SBDUTIL,” on page 183 


5.4.2 Installing Novell Cluster Services during an OES Installation 


This section describes only those steps in the install that are directly related to installing Novell 
Cluster Services. For detailed instructions on installing OES, see the OES 11 SP3: Installation Guide. 


Repeat the following procedure for each server that you want to add to the cluster: 


1 Start the YaST install for SUSE Linux Enterprise Server and continue to the Installation Mode 
page. 

2 Select New Installation, select Include Add-On Products from Separate Media, click Next, then 
continue through the OES add-on part of the install until you get to the Installation Settings page. 


3 On the Installation Settings page, click Software to open the Software Selection and System 
Tasks page. 


4 Under Open Enterprise Server, select Novell Cluster Services and any other OES components 
that you want to install, then click Accept. 
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When you select Novell Cluster Services, the following basic services for managing OES are 
automatically selected: 


+ Novell Backup / Storage Management 
+ Novell Linux User Management 
+ Novell Remote Manager 


The following Open Enterprise Server are not automatically selected, but are required for 
managing and configuring Novell Cluster Services: 


+ iManager must be installed on at least one server in the same tree. 


+ eDirectory must already be installed on at least one server in the tree where you are 
installing the cluster. You can install a replica on the cluster server. 


Select other protocols and services according to your planned setup. See Section 4.7, “Software 
Requirements for Cluster Resources,” on page 61. 


IMPORTANT: If you deselect a pattern after selecting it, you are instructing the installation 
program to not install that pattern and all of its dependent patterns. Rather than deselecting a 
pattern, click Cancel to cancel your software selections, then click the Software heading again to 
choose your selections again. 


Selecting only the patterns that you want to install ensures that the patterns and their dependent 
patterns and packages are installed. 


If you click Accept, then return to software pattern selection page, the selections that you made 
become your base selections and must be deselected if you want to remove them from the 
installation proposal. 


5 Continue through the installation process, but do not configure Novell Cluster Services when you 
reach the Novell Open Enterprise Server Configuration page. You configure it later. 


6 After the install, use the Software Updater (or other update methods) to download and apply any 
updates that are in the SLES and OES Updates channels. 


See “Updating (Patching) an OES 11 SP3 Server” in the OES 11 SP3: Installation Guide. 
7 Ensure that your SAN storage is working properly for the server. 


8 Continue with Section 5.5, “Configuring Novell Cluster Services,” on page 79. 
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5.4.3 


Installing Novell Cluster Services on an Existing OES 
Server 


If you did not install Novell Cluster Services during the OES 11 SP3 installation, you can install it later 
by using YaST > Open Enterprise Server > OES Install and Configuration. 


1 Log in to the server as the root user. 
2 In YaST, select Open Enterprise Server > OES Install and Configuration. 
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3 On the Software Selection page under Open Enterprise Server, select Novell Cluster Services 
and any other compatible OES components that you want to install. 


Preparation ° Software Selection 


> OES Configuration 


Pattern vir 


|E Open Enterprise ... 


E E Novell AFP 


© Novell Archive and Versi 


$ g Novell Backup / Storage 
P=] 
E oy Novell CIFS 


R 
Q29 Novell Cluster Services ( 


Novell DHCP 
W 


=G 
GE Novell DNS 


Novell Cluster Services (NCS) 


Novell Cluster Services is a server clustering 
system that ensures high availability and 
manageability of critical network resources 
including data, applications, and services. Itis a 
multinode clustering product for Linux that is 
enabled for Novell eDirectory and supports failover, 
fallback, and migration (load balancing) of 
individually managed cluster resources. 


Novell Cluster Services lets you create Linux 
clusters and set up cluster nodes for the cluster. 
For migration of NetWare 6.5 clusters, Novell 
Cluster Services allows you to install Linux nodes 
in a Netware 6.5 cluster to create a mixed-node 


cluster without bringing down the cluster while you 
perform a rolling cluster conversion from NetWare 
to Linux. 
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Services that you have already installed are indicated by a blue check mark in the status check 
box next to the service. 


For information about the options, see Step 4 in Section 5.4.2, “Installing Novell Cluster Services 
during an OES Installation,” on page 76. 


4 Click Accept to begin the install, then click Continue to accept changed packages. 


5 Continue through the installation process, but do not configure Novell Cluster Services when you 
reach the Novell Open Enterprise Server Configuration page. You configure it later. 


6 After the install, use the Software Updater (or other update methods) to download and apply any 
updates that are in the SLES and OES Updates channels. 


78 OES 11 SP3: Novell Cluster Services for Linux Administration Guide 


5.5 


5.5.1 


See “Updating (Patching) an OES 11 SP3 Server” in the OES 11 SP3: Installation Guide. 
7 Ensure that your SAN storage is working properly for the server. 
8 Continue with Section 5.5, “Configuring Novell Cluster Services,” on page 79. 


Configuring Novell Cluster Services 


After you install Novell Cluster Services, you use the Open Enterprise Server > OES Install and 
Configuration tool in YaST to set up the cluster or to add a node to the cluster. 


IMPORTANT: The YaST-based configuration is not used to modify the settings for an existing cluster. 
For information about modifying the settings for an existing cluster, see Section 8.13, “Moving a 
Cluster, or Changing the Node IP Addresses, LDAP Servers, or Administrator Credentials for a 
Cluster,” on page 143. 


If you are creating a new cluster, the Novell Cluster Services configuration does the following: 


¢ Creates a new Cluster object and a Cluster Node object in eDirectory. 


¢ Creates a special cluster partition for the Split Brain Detector (SBD) if you have a shared disk 
system. 


If you are adding a server to an existing cluster, the Novell Cluster Services configuration does the 
following: 


¢ Creates a new Cluster Node object in eDirectory. 
Use the following procedures to configure Novell Cluster Services on a node: 


¢ Section 5.5.1, “Initializing and Sharing a Device to Use for the SBD Partition,” on page 79 

¢ Section 5.5.2, “Opening the Novell Open Enterprise Server Configuration Page,” on page 81 

¢ Section 5.5.3, “Using Different LDAP Credentials for the Cluster Configuration,” on page 82 

¢ Section 5.5.4, “Accessing the Novell Cluster Services Configuration Page in YaST,” on page 82 
¢ Section 5.5.5, “Configuring a New Cluster,” on page 83 

¢ Section 5.5.6, “Adding a Node to an Existing Cluster,” on page 88 


Initializing and Sharing a Device to Use for the SBD 
Partition 


If you plan to use shared storage in the cluster, the cluster needs a split-brain detector (SBD). You 
must create the SBD before you add a second node to the cluster. You can create the SBD when you 
set up the cluster on the first node. In preparation, you must initialize the partition, and mark its device 
as shareable for clustering. If you plan to mirror the SBD, you must also initialize the partition that you 
want to use as the mirrored SBD, and mark its device as shareable for clustering. You need at least 
20 MB for the SBD. 


1 Log in as the root user on the server that will be the first node of the cluster, then open a 
terminal console. 


2 At the command prompt, enter 
nssmu 


3 Inthe NSSMU, select Devices and press Enter. 
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4 Inthe Devices list, select the device that you want to use for the SBD. 


“F3=Imt FS=Refresh F6=Share SPACE=Select/Unselect 


5 If the device has not been initialized or if you want to delete the current partitioning structures on 
the device, press F3, then press Y (Yes) to confirm and continue. 


WARNING: Initializing a disk destroys all of the data on it. 


6 Select the DOS or GPT partitioning scheme for the device, then press Enter. 
DOS supports devices up to 2 TB in size. GPT supports devices of any size. 


Wait for the page to refresh before continuing. 
7 Press F6 to mark the device as shareable for clustering. 
The Shareable for Clustering value changes from No to Yes. 


FImt FS=Refresh Fe=UnShare SPACE=Select/Unselect B _Fe=More— 


8 If you plan to mirror the SBD, repeat Step 4 through Step 7 for the second device. 
9 Exit NSSMU. 


10 Continue with Section 5.5.2, “Opening the Novell Open Enterprise Server Configuration Page,” 
on page 81. 
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5.5.2 Opening the Novell Open Enterprise Server Configuration 


Page 


1 Log in to the server as the root user. 
2 Verify that the OES Add-On DVD is mounted on or available to the server. 
3 In YaST, select Open Enterprise Server > OES Install and Configuration. 


YaST Control Center 


Filter 


(OO ) 


Groups Security and Users 


Hardware 

Miscellaneous a CA Management 
Network Devices 

Network Services ri Firewall 

Novell AppArmor 


Open Enterprise Server 


4 On the Software Selection page under Open Enterprise Server, verify that the Novell Cluster 
Services option is already installed as indicated by a blue check mark. 


Preparation 9 Software Selection 


> OES Configuration 


Pattern 


= Open Enterprise ... 


L4 E Novell AFP 


© Novell Archive and Versi. 


E g Novell Backup / Storage 


E ws Novell CIFS 


R 2 
Je) Novell Cluster Services ( 


Novell DHCP 
ZN 


R] Novell DNS 


Cn Novell Domain Services f. 


a 
S 


E T Novell eDirectory 
(ama) 
TO Novell FTP 


P Novell iFolder 
© @ } Novell iManager 


~ Novell iPrint 
kim. 


| Details 


| Help | 


5 Click Accept to proceed to the Novell Open Enterprise Server Configuration page. 


6 Do one of the following: 


+ Same Administrator: To use the same administrator credentials that were used to install 


{ 
| 
| 
| 
| 


KQ 


in) Common Server Certificate 


aft 
E Linux Audit Framework (LAF) 


(N 
Y4 Security Center and Hardening 8 Sudo 


Novell Cluster Services (NCS) 


Novell Cluster Services is a server clustering 
system that ensures high availability and 
manageability of critical network resources 
including data, applications, and services. Itis a 
multinode clustering product for Linux that is 
enabled for Novell eDirectory and supports failover, 
failback, and migration (load balancing) of 
individually managed cluster resources. 


Novell Cluster Services lets you create Linux 
clusters and set up cluster nodes for the cluster. 
For migration of NetWare 6.5 clusters, Novell 
Cluster Services allows you to install Linux nodes 
in a Netware 6.5 cluster to create a mixed-node 
cluster without bringing down the cluster while you 
perform a rolling cluster conversion from NetWare 
to Linux. 


Using Novell Cluster Services with iSCSI 
technologies included in OES. you can build 


inexnensive clustered SANs on cammodity ninahit 


Name Disk Usage Free Total 

1 E 2 47GB 84GB 

/boot W13% 164.0 MB 189.9 MB 
| Cancel | 


Novell Cluster Services, continue with Section 5.5.4, “Accessing the Novell Cluster Services 


Configuration Page in YaST,” on page 82. 


+ Different Administrator: To use different administrator credentials than those used to 
install Novell Cluster Services, continue with Section 5.5.3, “Using Different LDAP 


Credentials for the Cluster Configuration,” on page 82. 
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5.9.3 


Using Different LDAP Credentials for the Cluster 
Configuration 


You can use different user credentials to configure Novell Cluster Services than were used during the 
installation of Open Enterprise Server on the server by reconfiguring the settings for the LDAP 
Configuration of Open Enterprise Services option. 


For information about what rights are needed, see Section 5.3, “Assigning Install Rights for Container 
Administrators or Non-Administrator Users,” on page 74. 


1 


On the Novell Open Enterprise Server Configuration page under LDAP Configuration of Open 
Enterprise Services, click the disabled link to enable re-configuration. 


The sentence changes to Reconfiguration is enabled. 


Click the LDAP Configuration of Open Enterprise Services link to open the LDAP Configuration 
page. 
Specify the following values: 


+ Admin name and context: The user name and context (in LDAP form) of the container 
administrator user (or non-administrator user) who has the eDirectory rights needed to 
install Novell Cluster Services. 


+ Admin password: The password of the container administrator (or non-administrator user). 
Click Next. 
The install returns to the Novell Open Enterprise Server Configuration page. 


Continue with Section 5.5.4, “Accessing the Novell Cluster Services Configuration Page in 
YaST,” on page 82. 


5.5.4 Accessing the Novell Cluster Services Configuration Page 
in YaST 


1 


On the Novell Open Enterprise Server Configuration page under Novell Cluster Services, locate 
the Novell Cluster Services link. 


The configuration is currently disabled. 


Novell Cluster Services (NCS) 


Configure is disabled 
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2 Click the disabled link to enable configuration. 
The sentence changes to Configure is enabled. 


Novell Cluster Services (NCS) 


Novell Cluster Services (NCS) requires additional configuration information before continuing or 
disable the configuration. 


Configure is enabled 


e New or Existing Cluster: Existing Cluster 

è LDAP Servers: 10.10.10.37 

* LDAP Username: cn=admin, o=novell 

© Cluster object in the directory: cn=cluster, o=novell Default settings, not yet 
* NCS Proxy User: cn=OESCommonProxy_avalon, o=novell configured 

e Node name: avalon 

e Node's IP address: 10.10.10.37 

© Start Cluster Services: Now 


3 Click the Novell Cluster Services link to open the Novell Cluster Services Configuration page. 


4 If you are prompted for credentials, specify the password of the specified Administrator user, 
then click OK. 


eDirectory Tree: AVALON_TREE 
Admin User: cn=admin, o=novell 


Please enter the admin password: 


Cancel | 


This is either the LDAP administrator identity that was used when the Open Enterprise Server 
were installed, or the identity configured after the install in Section 5.5.3, “Using Different LDAP 
Credentials for the Cluster Configuration,” on page 82. 


5 On the Novell Cluster Services Configuration page, continue with one of the following: 
¢ Section 5.5.5, “Configuring a New Cluster,” on page 83 
+ Section 5.5.6, “Adding a Node to an Existing Cluster,” on page 88 


5.5.5 Configuring a New Cluster 


Perform the following configuration for the first node that you configure for a cluster: 


1 Go to the Novell Cluster Services Configuration page as described in Section 5.5.4, “Accessing 
the Novell Cluster Services Configuration Page in YaST,” on page 82. 
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YasT2 


® Novell Cluster Services (NCS) Configuration 


New or Existing Cluster 
@ New Cluster 
D Existing Cluster 


Directory Server Address 


| 10.10.10.37 


Cluster FDN (e.g. cn=cluster, o=novell) 


| cn=clus1,ou=nes,o=novell 


Browse 


Cluster IP address 


| 10.10.10.44 


Select the storage device with shared media 


| sdb 


Select the device where the mirror partition will be created (optional) 


[sde 


Desired partition size of s 


| Help | 


ared media (MB) 


M Use maximum size! 


Abort Back |{ Next | 


2 On the first configuration page, specify the following settings for a new cluster, then click Next: 


Parameter 


New or existing cluster 


Directory Server Address 


Action 


Select New Cluster. 


Select the check box next to the IP address of the LDAP server you want to 


use as the default for this node. The local LDAP server is selected by 
default. 


The IP addresses shown are the LDAP servers available for this service to 
use. The LDAP servers must have a master replica or a Read/Write replica 
of eDirectory. 


You can add, remove, or change the order of available LDAP servers for the 
node after the setup is complete. See Section 8.13.1, “Changing the 
Administrator Credentials or LDAP Server IP Addresses for a Cluster,” on 
page 143. 
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Parameter 


Cluster FDN 


Action 


Click Browse and navigate the tree to select the container where you want 
to create the cluster, then click OK. The FDN is automatically added to the 
field with a suggested cluster name. You can specify a different cluster 
name. 


Browse for container 


Y o=novell | 
cn=admingroup. o=novell 
cn=novixtier, o=novell 
cn=www, o=novell 
cn=admin, o=novell 
cn=avalonadmin, o=novell 
cn=novixregd, o=novell 
cn=novixsrvd, o=novell 
cn=OESCommonProxy_avalon, o=novell 
cn=wwwrun, o=novell 
cn=avalon_SYS, o=novell 
cn=avalon, o=novell 
cn=avalon-PS, o=novell 
cn=LDAP Server - avalon, o=novell 
cn=LDAP Group - avalon, o=novell 
cn=Http Server - avalon, o=novell D 


Cancel 


You can also specify the typeful FDN (fully distinguished name) of the 
existing cluster. The name is case sensitive. Use the comma format 
illustrated in the example. Do not use dots. 


For example: 
cn=clus1, ou=ncs , o=mycompany 


You must specify an existing context. Specifying a new context does not 
create a new context. 


Cluster names must be unique. You cannot create two clusters with the 
same name in the same eDirectory tree. 


Cluster IP Address 


The cluster IP address represents the cluster on the network. It is different 
than the server IP address. For example: 


10.10.10.44 


The cluster IP address provides a single point for cluster access, 
configuration, and management. A Master IP Address resource is created 
automatically during the Cluster Services installation. The cluster IP address 
is bound to the master node and remains with the master node regardless of 
which server is the master node. 


The cluster IP address is required to be on the same IP subnet as the other 
servers in the same cluster, which is necessary for certain external network 
management programs to get cluster status alerts. 
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Parameter 


Select the storage device 


with shared media 


Action 


Select the initialized and shared device that you want to use for the SBD 
from the drop-down list. 


For a new cluster, you can create the SBD partition now, or you can create it 
manually at any time before you add a second node to the cluster. 


A split-brain detector (SBD) is required if you plan to use shared disks in the 
cluster. For information about SBD requirements, see Section 4.8.2, “SBD 
Partitions,” on page 65. 


The drop-down menus show only devices that have been initialized and 
shared. See Section 5.5.1, “Initializing and Sharing a Device to Use for the 
SBD Partition,” on page 79. 


Select the storage device with shared media 
sdb 
sdc 


sdd 


TEIM purer see er srrarce Trreara tywinoy 


Select the device where the 


mirror partition will be 


created 


If you want to mirror the SBD, select a different shared device from the drop- 
down list. 


Desired partition size of 


shared media 


Specify a size of 20 MB or greater to use for the SBD partition, or select Use 
maximum size to use the entire device. 


If you selected a device for the SBD mirror, the specified size is also used 
for the mirror segment. 


On the Proxy User Configuration page, specify one of the following users as the NCS Proxy 
user, then click Next. 


YaST2 


® Novell Cluster Services (NCS) Proxy User Configuration 


Help 


User Name (e.g. cn=admin. o=novell) 


cn=OESCommonProxy_avalon.o=novell 


ify NCS 


rene 


User Password 


M] Use OES Common Proxy User 
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Parameter 


OES Common Proxy User 


Action 


If the OES Common Proxy User is enabled in eDirectory, the Use OES 
Common Proxy User check box is automatically selected and the NCS 
Proxy User Name and Specify NCS Proxy User Password fields are 
populated with the credentials of the OES Common Proxy User. 


LDAP Admin User 


If the OES Common Proxy User is disabled in eDirectory, the Use OES 
Common Proxy User check box is automatically deselected and the NCS 
Proxy User Name and Specify NCS Proxy User Password fields are 
populated with the credentials of the LDAP Admin user. The fields are also 
automatically populated with the LDAP Admin credentials if you deselect 
the Use OES Common Proxy User check box. 


Another Admin User 


Deselect the Use OES Common Proxy User check box, then specify the 
credentials of an existing administrator user. 


You can reset the default settings by clicking Back to return to the Novell Cluster Services 


Configuration page, then clicking Next to continue again to the Proxy User Configuration page. 


4 On the third Configuration page, configure the following settings, then click Finish. 


YaST2 


® Novell Cluster Services (NCS) Configuration 


Name of this node: avalon 


IP address of this node 


| 10.10.10.37 


| Start Clustering Services now 


Parameter 


IP address of this node 


Abort Back Finish 


Action 


From the drop-down list, select the IP address that Novell Cluster 
Services will use for this node. 


Some servers have multiple IP addresses. This step lets you choose 
which IP address Novell Cluster Services uses. 


Select the check box to start Novell Cluster Services software on this 


Start Clustering Services now 


node after configuring it. 
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5 On the OES Server Configuration page, scroll down to the Novell Cluster Services entry to 
review the summary of the Cluster Services configuration, then click Next. 


YasST2 Sele. 


(I Novell Open Enterprise Server Configuration 


D Skip Configuration 
® Use Following Configuration 


Novell Cluster Services (NCS) 
Configure is enabled 


e New or Existing Cluster: New Cluster 

e LDAP Servers: 10.10.10.37 

* LDAP Username: cn=admin, o=novell 

e Cluster object in the directory: cn=cluster, o=novell 
* NCS Proxy User: cn=OESCommonProxy_avalon, o=novell 
* Node name: avalon 

e Node's IP address: 10.10.10.37 

e Cluster IP address: 10.10.10.44 

e SBD device: sdb 

e SBD mirror device: sdc 

e SBD size: Maximum Size 

e Start Cluster Services: Now 


NetWare Core Protocol (NCP) Server 


Reconfigure is disabled 


a 


| Change... > | 


| Help Abot || Back || Next 


6 Continue through the setup process, then click Finish to exit the OES Configuration 
7 Start Novell Cluster Services using one of these methods: 


Setup Condition Instructions 


Start Cluster Services now was Novell Cluster Services starts automatically after the configuration 
enabled completes. 


Start Cluster Services now was Start Novell Cluster Services manually by using one of these methods: 


disabled + Reboot the cluster server. 


+ Atacommand prompt, go to the /etc/init.d directory, then enter 
the following as the root user: 


./novell-nes start 
+ Ata command prompt, enter the following as the root user: 


renovell-ncs start 


8 Continue with Section 5.6, “Configuring Additional Administrators,” on page 92. 


5.5.6 Adding a Node to an Existing Cluster 


Perform the following configuration for each node that you add to an existing cluster: 
1 If you have not previously configured the SBD partition for the cluster, create an SBD partition for 
the cluster by using one of the following procedures: 


¢ Section 9.18.3, “Creating a Non-Mirrored Cluster SBD Partition with SBDUTIL,” on 
page 176 


¢ Section 9.18.5, “Creating a Mirrored Cluster SBD Partition with SBDUTIL,” on page 183 
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If you have a shared disk system attached to your cluster servers, an SBD partition is required 
and must be created before you configure the second node in the cluster. 


IMPORTANT: An SBD partition requires least 20 MB of free space on a device that has been 
previously initialized and marked as shareable for clustering. 


2 Go to the Novell Cluster Services Configuration page as described in Section 5.5.4, “Accessing 
the Novell Cluster Services Configuration Page in YaST,” on page 82. 


YaST2 =œ fl E3 


© Novell Cluster Services (NCS) Configuration 


New or Existing Cluster 
D New Cluster 

@ Existing Cluster 
Directory Server Address 
[Æ 10.10.10.37 


Cluster FDN (e.g. cn=cluster, o=novell) 


cn=clus1,0u=ncs,o=novell Browse 


Cluster IP addre 


| ___ Abort Back = | Next | 


3 Specify the following settings for adding this node to an existing cluster, then click Next: 


Parameter Action 
New or existing cluster Select Existing Cluster. 
Directory Server Address Select the check box next to the IP address of the LDAP server you 


want to use as the default for this node. The local LDAP server is 
selected by default. 


The IP addresses shown are the LDAP servers available for this service 
to use. The LDAP servers must have a master replica or a Read/Write 
replica of eDirectory. 


You can add, remove, or change the order of available LDAP servers for 
the node after the setup is complete. See Section 8.13.1, “Changing the 
Administrator Credentials or LDAP Server IP Addresses for a Cluster,” 
on page 143. 
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Parameter Action 


Cluster FDN Click Browse and navigate the tree to select the Cluster object of the 
existing cluster, then click OK. The FDN is automatically added to the 
field. 


Browse for container 


| ¥ o=novell 
ou=ncs.o=novell 
ou=users,o=novell 


cn=clus1,0u=ncs,o=novell 
cn=admingroup, o=novell 
cn=novixtier, o=novell 
cn=www, o=novell 
cn=admin, o=novell 
cn=avalonadmin, o=novell 

cn=novixregd, o=novell 

cn=novixsivd, o=novell 
cn=OESCommonProxy_avalon, o=novell 
cn=wwwrun, o=novell 

cn=avalon_SYS, o=novell 

cn=avalon, o=novell 

cn=avalon-PS, o=novell 

cn=LDAP Server - avalon, o=novell 
cn=LDAP Group - avalon, o=novell 


You can also specify the typeful FDN (fully distinguished name) of the 
existing cluster. The name is case sensitive. Use the comma format 
illustrated in the example. Do not use dots. 


For example: 
cn=clus1,ou=ncs,o=mycompany 


Select the device where the If you want to mirror the SBD, select a different shared device from the 
mirror partition will be created drop-down list. 


4 On the Proxy User Configuration page, specify one of the following users as the NCS Proxy user 
for this node, then click Next. 


YaST2 of 8 


® Novell Cluster Services (NCS) Proxy User Configuration 


NCS Proxy User Name (e.g. cn=admin.o=novell) 


cn=OESCommonProxy_av 


Specify NCS Proxy User Password 


fe 


| Use OES Common Proxy User 


Help Abort Back || Next 
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Parameter 


OES Common Proxy User 


Action 


If the OES Common Proxy User is enabled in eDirectory, the Use OES 
Common Proxy User check box is automatically selected and the NCS 
Proxy User Name and Specify NCS Proxy User Password fields are 
populated with the credentials of the OES Common Proxy User. 


LDAP Admin User 


If the OES Common Proxy User is disabled in eDirectory, the Use OES 
Common Proxy User check box is automatically deselected and the 
NCS Proxy User Name and Specify NCS Proxy User Password fields 
are populated with the credentials of the LDAP Admin user. The fields 
are also automatically populated with the LDAP Admin credentials if you 
deselect the Use OES Common Proxy User check box. 


Another Admin User 


Deselect the Use OES Common Proxy User check box, then specify the 
credentials of an existing administrator user. 


You can reset the default settings by clicking Back to return to the Novell Cluster Services 


Configuration page, then clicking Next to continue again to the Proxy User Configuration page. 


5 On the third Configuration page, configure the following settings, then click Finish. 


YasST2 


9 Novell Cluster Services (NCS) Configuration 


Name of this node: avalon 


IP address of this node 


|10.10.10.37 


| Start Clustering Services now 


Help 


Parameter 


IP address of this node 


Abort Back Finish 


Action 


From the drop-down list, select the IP address that Novell Cluster 
Services will use for this node. 


Some servers have multiple IP addresses. This step lets you choose 
which IP address Novell Cluster Services uses. 


Start Clustering Services now 


Select the check box to start Novell Cluster Services software on this 
node after configuring it. 
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5.6 


6 On the OES Server Configuration page, scroll down to the Novell Cluster Services entry to 
review the summary of the Cluster Services configuration, then click Next. 


7 Continue through the setup process, then click Finish to exit the OES Configuration 


8 Start Novell Cluster Services by using one of these methods: 


Setup Condition Instructions 


Start Cluster Services now was Novell Cluster Services starts automatically after the configuration 
enabled completes. 


Start Cluster Services now was Start Novell Cluster Services manually by using one of these methods: 
disabled 
+ Reboot the cluster server. 


+ Atacommand prompt, go to the /etc/init.d directory, then enter 
the following as the root user: 


./novell-necs start 
+ Ata command prompt, enter the following as the root user: 


renovell-ncs start 


9 Continue with Section 5.6, “Configuring Additional Administrators,” on page 92. 


Configuring Additional Administrators 


The Administrator user that you specify as the Novell Proxy User during Novell Cluster Services 
install process is automatically configured as the administrator for the cluster with the following setup: 


+ The user is a trustee and has the Supervisor right to the Server object of each server node in the 
cluster. 


¢ The user is enabled for Linux with Linux User Management. This gives the user a Linux UID in 
addition to the users eDirectory GUID. 


+ The user is a member of a LUM-enabled administrator group associated with the servers in the 
cluster. 


IMPORTANT: To allow other administrators (Such as the tree administrator) to manage the cluster, 
the users’ user names must be similarly configured. 


You can modify the default administrator user name or password after the install by following the 
procedure in Section 8.13.1, “Changing the Administrator Credentials or LDAP Server IP Addresses 
for a Cluster,” on page 143. 
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5.7 Installing or Updating the Clusters Plug-in for 
iManager 


The Clusters plug-in for iManager was reorganized in OES 11 SP1. On the Roles and Tasks page 
under Clusters, the Cluster Manager, BCC Manager, Cluster Event Log, and Cluster Options menu 
options have been replaced with two options: My Clusters and My Resources. 


¢ My Clusters: The logged-in cluster administrator can set up a personalized list of clusters to 
manage, which allows their status to be viewed at-a-glance. The list persists between the 
administrator’s logins to iManager in the same tree. See Section 8.2, “Setting Up a Personalized 
List of Clusters to Manage,” on page 117. 


My Resources: The logged-in cluster administrator can set up a personalized list of resources 
to manage, which allows their status to be viewed at-a-glance. The list persists between the 
administrator’s logins to iManager in the same tree. See Section 10.2, “Setting Up a 
Personalized List of Resources to Manage,” on page 195. 


Links on the these pages take you to the familiar cluster options presented as tabs: Cluster Manager, 
BCC Manager, Cluster Event Log, and Cluster Options. 


Use the information in the following sections to install or update the Clusters plug-in. 


¢ Section 5.7.1, “Prerequisites for Installing or Updating the Clusters Plug-In,” on page 93 
¢ Section 5.7.2, “Installing the Clusters Plug-In,” on page 93 
¢ Section 5.7.3, “Uninstalling and Reinstalling the Clusters Plug-In,” on page 94 


¢ Section 5.7.4, “Updating Role-Based Services for the Clusters Plug-In after Upgrading to OES 
11 SP1 or later,” on page 94 


5.7.1 Prerequisites for Installing or Updating the Clusters Plug-In 


The Clusters plug-in supports the management of OES and NetWare clusters and resources. It 
cannot be installed on a NetWare server. 


The Clusters plug-in requires the following components to be installed in iManager: 


¢ Clusters (ncsmgmt . rpm) 
+ Common code for storage-related plug-ins (storagemgmt . rpm) 
See “Storage-Related Plug-Ins for iManager” on page 59. 


5.7.2 Installing the Clusters Plug-In 


If you are installing a new instance of Novell iManager 2.7.5 or later and the Clusters plug-in on a 
computer, follow the instructions in “Downloading and Installing Plug-in Modules” in the NetlO® 
iManager Administration Guide. Ensure that you install the Clusters plug-in (ncsmgmt . rpm) as well as 
the common code for storage-related plug-ins (storagemgmt . rpm). 


Verify that the /var/opt /novell/iManager/nps/WEB-INF/1ib directory contains the class loader 
file commons-lang-2.6.jar (or later version), then remove all earlier versions of the file. The 
Clusters plug-in for Novell iManager 2.7.5 requires commons-lang-2.6.jar (or later version) of the 
class loader file. Novell iManager uses one class loader for all of its plug-ins. If multiple versions of 
the class loader file exist in the /var/opt /novell/iManager/nps/WEB-INF/1ib directory, iManager 
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5.7.3 


5.7.4 


loads whichever one comes first alphabetically. You must remove the earlier versions (such as 
commons-lang.jar Or commons-lang-2.4.jar) to ensure that iManager loads the 2.6 or later 
version of the class loader file. Restart Tomcat when you are done. 


To configure role-based services for the Clusters plug-in, see “RBS Configuration” in the NetiQ® 
iManager Administration Guide. 


Uninstalling and Reinstalling the Clusters Plug-In 


Use the procedure in this section to update an instance of the Clusters plug-in, or to add the Clusters 
plug-in on a computer where other storage-related plug-ins are already installed. 


1 In iManager, uninstall the currently installed storage-related plug-ins. 


2 Copy the new version of the plug-in files to the iManager plug-ins location, manually overwriting 
the older version of the plug-in in the packages folder with the newer version of the plug-in. 


3 In iManager, install all of the storage-related plug-ins, or install the plug-ins you need, plus the 
common code. 


4 If you are updating the Clusters plug-in, delete the contents of the /var/opt /novell/tomcaté/ 
work/Catalina/localhost/nps work folder. 


You must manually delete the old compiled JSPs that are cached in the nps work folder. This 
ensures that only the latest files are cached. 


5 Verify that the /var/opt /novell/iManager/nps/WEB-INF/1ib directory contains the class 
loader file commons-lang-2.6.jar (or later version), then remove all earlier versions of the file 
from the directory. 


The Clusters plug-in for Novell iManager 2.7.5 requires commons-lang-2.6.jar (or later 
version) of the class loader file. Novell iManager uses one class loader for all of its plug-ins. If 
multiple versions of the class loader file exist in the /var/opt /novell/iManager/nps/WEB- 
INF/1lib directory, iManager loads whichever one comes first alphabetically. You must remove 
the earlier versions (Such as commons-lang.jar Of commons-lang-2.4.jar) to ensure that 
iManager loads the 2.6 or later version of the class loader file. 


6 Restart Tomcat by entering the following command, or reboot the server if a reboot is required by 
any of the patches applied. 


renovell-tomcat6é restart 


7 If you use Role-Based Services, continue with Section 5.7.4, “Updating Role-Based Services for 
the Clusters Plug-In after Upgrading to OES 11 SP1 or later,” on page 94. 


Updating Role-Based Services for the Clusters Plug-In after 
Upgrading to OES 11 SP1 or later 


In OES 11 SP1 or later, the Clusters plug-in replaces the Clusters, the Cluster Manager, BCC 
Manager, Cluster Event Log, and Cluster Options menu options with the My Clusters and My 
Resources options. The plug-in is updated automatically to show new tasks, and hide old ones. 
However, the Role-Based Services role for Clusters is not updated automatically. 


If you use Role-Based Services, you must reinstall the Clusters plug-in on the Role-Based Services 
Configuration page in order to pick up the modified menu options: 

1 In iManager, click Configuration, then select Role Based Services > RBS Configuration. 

2 Select the iManager 2.x Collections tab. 


3 On the iManager 2.x Collections page, view the entry for Role Based Services 2.novell. 
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There are numbers in the columns for Modules, Installed, Out-of-Date, and Not-Installed. 
4 Click the number link in the Out-of-Date column for Role Based Services 2.novell. 


ol 


Select the check box next to Clusters, then click Update. 

This updates the RBS configuration information for the Clusters plug-in. 
Click OK to confirm the reinstallation. 

After the reinstallation is complete, click OK to confirm the success message. 


Log out of iManager. 


o ON O 


any of the patches applied. 
renovell-tomcat6 restart 


10 Log in to iManager to use the updated Clusters plug-in. 


5.8 Patching Novell Cluster Services 


5.9 


You should stop Novell Cluster Services when applying maintenance patches for Novell Cluster 
Services. 


1 Log in to the node as the root user, then open a terminal console. 
2 Use the cluster leave command to remove the node from the cluster. 


3 Stop Novell Cluster Services by entering 
renovell-nes stop 


4 Apply the latest patches for OES and Novell Cluster Services. 
5 Start Novell Cluster Services by entering 


renovell-nes start 


6 Use the cluster join command to rejoin the node to the cluster. 


Removing the NCS Configuration Information 
from a Node 


You can use the /opt/novell/ncs/install/nes_install.py -r script to remove Novell Cluster 


Restart Tomcat by entering the following command, or reboot the server if a reboot is required by 


Services configuration information from a node to return it to a pre-configured state. This is useful for 


the following scenarios: 


¢ Ifthe Novell Cluster Services configuration is unsuccessful, you might have a partial 
configuration that prevents you from properly configuring the node for a cluster. 


+ You want to move anode from one cluster to another cluster. 


If this is a one-node cluster and you created an SBD, you must delete the SBD partition (and possibly 


re-initialize if it is a standalone disk). If the SBD is mirrored, delete both the mirror and the SBD 
partition before you re-configure the cluster for the single-node. 
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After you remove the cluster configuration information, you can start over with the configuration of 
Novell Cluster Services on the node. 
1 Log in as the root user to the node that you want to manage, then open a terminal console. 


2 Inatext editor, create a text file, specify the credentials for the Novell Cluster Services cluster in 
it, then save the file. 


This file contains a password in clear text. For security reasons, ensure that you delete the file 
when you are done. 


The following lines are an example of the content of a file, with sample values. The directives are 
self-explanatory. 


IMPORTANT: Ensure that you change the values inside the quotation marks to the actual 
settings for your cluster. 


CONFIG _NCS_CLUSTER_DN="cn=clus1,o0u=ncs,o=novell" 
CONFIG NCS ADMIN DN="cn=admin,o=novell" 
CONFIG NCS ADMIN _PASSWORD="password" 


3 If the node is configured and working in a cluster, leave the cluster. Ata command prompt, enter 
cluster leave 


This cluster migrates any resources running on the node to other nodes in the cluster. When the 
node has successfully left the cluster, the following message is displayed: 


Leaving... 
No longer a member of cluster cluster_name 


4 Stop Novell Cluster Services if it is running. At the command prompt, enter 
renovell-necs stop 
Wait until the service has been unloaded. 


Stopping Novell Cluster Services 
This node is not a member of the cluster 


Pa SaaS HS CaaS ae oS ee as Soe a ee a a + 
# | 
# Please wait for the Novell Cluster Services KOs to unload 

# | 
HAS eee SSS ee ee Se Se ee eS le Ce Se ee eee ee eee + 


Novell Cluster Services Unloaded 
done 


5 At the command prompt, enter 
/opt/novell/necs/install/ncs_install.py -r [-f£ <configuration_file name>] 


Without the -£ option or applicable variables in the configuration file, /opt /novell/nes/ 
install/nes_install.py prompts you to enter needed information. 


6 You can check the return code (echo $?) of the command to see if the command is successful 
(0). Detailed log information is appended to /var/opt/novell/install/neslog. 
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07/16/13 13:19:49: *** Starting NCS Post-Install *** 

07/16/13 13:19:49: config type is: Existing Cluster. 

07/16/13 13:19:49: ldap ip is: 10.10.10.37. 

07/16/13 13:19:49: ldap port is: 636. 

07/16/13 13:19:49: ldap server list is: ldaps://10.10.10.37:636. 
07/16/13 13:19:49: Admin dn is: cn=admin,o=novell. 

07/16/13 13:19:49: serverName is: myserver. 

07/16/13 13:19:49: serverDn is: cn=myserver,O=novell. 

07/16/13 13:19:49: server IP is: 10.10.10.37. 

07/16/13 13:19:49: cluster dn is: cn=cl134,ou=ncs,o=novell. 
07/16/13 13:19:49: Extend schema flag is: False. 

07/16/13 13:19:49: Create cluster object flag is: False. 

07/16/13 13:19:49: Add node flag is: False. 

07/16/13 13:19:49: Delete node flag is: True. 

07/16/13 13:19:49: Create node name file flag is: False. 

07/16/13 13:19:49: Create cluster lib config file flag is: False. 
07/16/13 13:19:49: Create SBD flag is: False. 

07/16/13 13:19:49: Start requested flag is: False. 

07/16/13 13:19:49: DSFW Enabled is: False. 

07/16/13 13:19:49: Set Proxy User: False. 

07/16/13 13:19:49: Binding to LDAP server 

07/16/13 13:19:49: Deleting server 'cn=myserver,O=novell' from cluster 
'cn=c1134,o0u=ncs,o=novell' 

07/16/13 13:19:49: Server 'cn=myserver,O=novell' deleted from cluster 
'cn=c1134,ou=ncs,o=novell'. 

07/16/13 13:19:49: *** Ending NCS Post-Install *** 


7 Configure Novell Cluster Services on the node as described in Section 5.5, “Configuring Novell 
Cluster Services,” on page 79. 


Removing a Node from a Cluster 


You can use the procedure in this section to permanently remove a cluster node from the cluster. You 
must remove information about the node, even if you will replace the old server with a new server that 
has the same node name and IP address. 


To delete a cluster node from a cluster: 


1 Log in as the root user to the node in the cluster that you want to remove, then enter the 
following at a command prompt: 


cluster leav 


e 


When the node has successfully left the cluster, the following message is displayed: 


No longer a member of cluster cluster name 


2 In aweb browser, open iManager, then log in to the eDirectory tree that contains the cluster you 


want to manag 


e. 


IMPORTANT: Log in as an administrator user who has sufficient rights in eDirectory to delete 
and modify eDirectory objects. 
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3 In iManager, delete the node’s Cluster Node object from the cluster container: 


3a Select Directory Administration > Delete Objects. 


3b Browse to the Cluster container (>) of the cluster, locate and select the Cluster Node 
object (P) for the node in the container, then click OK. 


3c On the Delete Objects page, click OK, then click OK again to confirm the deletion of the 
Cluster Node object. 


4 Select Directory Administration > Modify Object, select the eDirectory Server object for the 
node that is being removed from the cluster, remove its NCS attributes, then click OK to save 
and apply your changes. 


5 If the deleted cluster node persists in iManager, do one of the following: 
+ Run the following command as the root user on the master cluster node. It is safe to run 
the command on an active cluster: 


/opt/novell/ncs/bin/nces-configd.py -init 


+ If you are converting a cluster from NetWare to Linux, you must restart the cluster instead 
so that clstrlib.ko is reloaded: 


renovell-necs restart 


6 (Optional) Build a replacement server with the same node name and IP address, and add it to 
the cluster. See Section 5.11, “Adding a Node That Was Previously in the Cluster,” on page 98. 


5.11 Adding a Node That Was Previously in the Cluster 


You can use the procedure in this section if you need to rebuild a node and want to use the same 
node name and IP address of the node it replaces. 


1 If the Cluster object for the old server is still present, delete the object and force the cluster to 
recognize that the node has been permanently removed. 
See Section 5.10, “Removing a Node from a Cluster,” on page 97. 


2 Inthe SAN, assign the shared storage array and devices to the replacement server before you 
install Novell Cluster Services. 


3 Install the OES platform and apply the latest patches. Ensure that you use the same node name 
and IP address of the node that was previously in the cluster. 


4 Install Novell Cluster Services on the replacement server. 
Section 5.4.3, “Installing Novell Cluster Services on an Existing OES Server,” on page 78. 


5 On the Novell Open Enterprise Server Configuration page under Novell Cluster Services, locate 
the Novell Cluster Services link, enable the configuration, then click the Novell Cluster Services 
link to open the Novell Cluster Services Configuration wizard. 


For information see, Section 5.5.4, “Accessing the Novell Cluster Services Configuration Page in 
YaST,” on page 82. 


6 Configure the replacement node for the existing cluster. The settings should be the same as 
those for the old server. 


See Section 5.5.6, “Adding a Node to an Existing Cluster,” on page 88. 


After you restart Novell Cluster Services, the replacement server assumes its old identity in the 
cluster. 
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What’s Next 


After installing Novell Cluster Services on OES servers (physical servers or virtual guest servers), you 
can configure and manage the cluster and cluster resources. See the following: 


+ 


+ 


+ 


Chapter 8, “ Configuring Cluster Policies, Protocols, and Properties,” on page 113 
Chapter 9, “ Managing Clusters,” on page 151. 
Chapter 10, “Configuring and Managing Cluster Resources,” on page 193 


Chapter 12, “Configuring and Managing Cluster Resources for Shared NSS Pools and 
Volumes,” on page 237 


Chapter 13, “Configuring and Managing Cluster Resources for Shared LVM Volume Groups,” on 
page 327 


Chapter 14, “Upgrading and Managing Cluster Resources for Linux POSIX Volumes with CSM 
Containers,” on page 399 


If you install Novell Cluster Services at the host level of an OES virtualized server, you can create 
cluster resources for the virtual machines. See Section 15.2, “Virtual Machines as Cluster 
Resources,” on page 422. 
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Upgrading OES 11 Clusters 


This section describes how to upgrade a Novell Cluster Services cluster and the file system 
resources from Novell Open Enterprise Server (OES) 11 to OES 11 SP1, from OES 11 SP1 to OES 
11 SP2, or from OES 11 SP2 to OES 11 SP3. See the individual service guides for information about 
upgrading clustered services. 

¢ Section 6.1, “Requirements and Guidelines for Upgrading Clusters,” on page 101 

¢ Section 6.2, “Upgrading Nodes in the Cluster (Rolling Cluster Upgrade),” on page 101 

¢ Section 6.3, “Upgrade Issues for OES 11 SP1,” on page 104 

¢ Section 6.4, “Upgrade Issues for OES 11 SP2,” on page 104 


Requirements and Guidelines for Upgrading 
Clusters 


As you upgrade a cluster to the next SP release version for the OES 11 software, you have a mixed- 
mode cluster made up of nodes running the old platform and the next SP platform. In addition to the 
Chapter 4, “Planning for Novell Cluster Services,” on page 47, consider the following rules and 
recommendations for mixed clusters during an upgrade to the next SP release: 


+ Mixed-mode clusters should be considered a temporary configuration that exists only during an 
upgrade. 

+ Adding a new cluster node with the old version to a mixed-mode cluster is not supported. 

+ NSS pool cluster resources can fail over to any node in the mixed-mode cluster. 

+ LVM volume group cluster resources can fail over to any node in the mixed-mode cluster. 


¢ CSM cluster resources can fail over to any node in the mixed-mode cluster. 


+ 


No storage management functions should be executed while a cluster is in mixed-mode unless 
you must do so as part of the documented upgrade process. Do not attempt to create, delete, 
expand, or modify the properties for partitions, pools, or volumes for any shared resources in the 
cluster. 


Upgrading Nodes in the Cluster (Rolling Cluster 
Upgrade) 


Performing a rolling cluster upgrade lets you keep your cluster up and running and lets your users 
continue to access cluster resources while the upgrade is being performed. 


During a rolling cluster upgrade, one OES server is upgraded at a time to the next SP release. You 
can also add new nodes running the next SP release. You should complete the upgrade as soon as 
possible. Don't leave the cluster in a mixed-mode state for an extended period. 


Upgrading OES 11 Clusters 101 


To perform a rolling cluster upgrade: 


1 Make a note of the OES components that are installed on the existing cluster nodes. 


You will probably want to install the same OES components on any new nodes that you add to 
the cluster. 


2 If you are adding new nodes, prepare the nodes for the cluster, but do not allow them to join the 
cluster. 


2a Install SUSE Linux Enterprise Server (SLES) 11 SP4 and the OES Services from the OES 
11 SP3 Add-On DVD, including Novell Cluster Services, but do not configure the node for 
the cluster at this time. 


2b Verify that the server is functioning properly. 


2c In YaST, go to the Novell Cluster Services Configuration page as described in Section 5.5.4, 
“Accessing the Novell Cluster Services Configuration Page in YaST,” on page 82. 


2d Configure the node for the existing OES cluster as described in Section 5.5.6, “Adding a 
Node to an Existing Cluster,” on page 88. Complete the following fields: 


Parameter Action 
LDAP administrator user password Specify the password of the user name shown, then click 
OK. 


Typically, this is the LDAP administrator identity that was 
used when the OES Services were installed, or the identity 
configured after the install in Section 5.5.3, “Using Different 
LDAP Credentials for the Cluster Configuration,” on 


page 82. 
New or existing cluster Select Existing Cluster. 
Directory Server Address Select the check box next to the IP address of the LDAP 


server you want to use as the default for this node. The 
local LDAP server is selected by default. 


You can add, remove, or change the order of available 
LDAP servers for the node after the setup is complete. See 
Section 8.13.1, “Changing the Administrator Credentials or 
LDAP Server IP Addresses for a Cluster,” on page 143. 


Cluster FDN Click Browse, navigate the tree to select the existing 
Cluster object for the OES 11 cluster, click OK, then click 
Next. 

NCS Proxy User Name Specify one of the following users as the NCS Proxy user 


for this server, then click Next: 


+ OES Common Proxy User (default if it was configured 
for the server) 


+ LDAP Admin User 


+ Another Administrator User 


IP address of this node From the drop-down list, select the IP address that Novell 
Cluster Services will use for this node. 


Start Cluster Services now Deselect the check box. 


Do not start cluster services on this node or join the cluster 
until Step 4, after all of the Linux POSIX cluster resources 
have been taken offline. 
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2e Click Finish, review the summary, then click Next to complete the configuration. 
2f Click Finish to close the OES Configuration dialog box. 


3 For each of the new nodes in turn, start Novell Cluster services manually by using one of the 
following methods, and allow the node to join the existing cluster. 


+ Reboot the cluster server. 

+ Ata command prompt, go to the /etc/init.d directory, then enter the following as the 
root user: 
./novell-nes start 

+ Ata command prompt, enter the following as the root user: 


renovell-nes start 


4 For each new node, ensure that you modify the Preferred Nodes list accordingly for each of the 
cluster resources. 


5 For each of the existing cluster nodes in turn: 
5a Log in to the node as the root user, then open a terminal console. 
5b Use the cluster leave command to remove the node from the cluster. 


Any cluster resources that were running on the server should fail over to another server in 
its preferred nodes list. 


You can also manually cluster migrate the resources to another server in the cluster prior to 
bringing down the server. 


5c Stop Novell Cluster Services by entering 
renovell-ncs stop 


5d_ If the autostart of Novell Cluster Services is enabled, you must disable autostart in order to 
prevent it from automatically loading Novell Cluster Services during the upgrade. Enter 


chkconfig -s novell-ncs off 

5e Apply the next SP release as an upgrade, and fully patch the system. 

5f (Optional) Enable the autostart of Novell Cluster Services for the node, enter 
chkconfig -s novell-ncs on 

5g Start Novell Cluster Services by entering 
renovell-necs start 

5h Use the cluster join command to rejoin the node to the cluster. 

5i Modify the Preferred Nodes list accordingly for each of the cluster resources. 


5j Repeat these steps for each existing node in the cluster. 


6 After all of the existing nodes have been upgraded and any new nodes added, the conversion is 
complete. 
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6.4 


Upgrade Issues for OES 11 SP1 


This section contains known issues for upgrading clusters from OES 11 to OES 11 SP1. 


¢ Section 6.3.1, “Updating the Clusters Plug-in and Role-Based Services in iManager,” on 
page 104 


¢ Section 6.3.2, “DHCP Cluster Resource: Path Change for dhcpd.pid,” on page 104 


Updating the Clusters Plug-in and Role-Based Services in 
iManager 


In OES 11 SP1, the Clusters plug-in replaces the Cluster Manager, BCC Manager, Cluster Event 
Log, and Cluster Options menu options with the My Clusters and My Resources options. The former 
menu options appear as tabs when you select a cluster from the My Clusters page. The plug-in is 
updated automatically to show new tasks, and hide old ones. However, the Role-Based Services role 
for Clusters is not updated automatically. 


If you use Role-Based Services, the Clusters plug-in must be updated manually on the Role-Based 
Services Configuration page in order to pick up the modified menu options. See Section 5.7, 
“Installing or Updating the Clusters Plug-in for iManager,” on page 93. 


DHCP Cluster Resource: Path Change for dhcpd.pid 


The DHCP process ID file location was changed from /var/run/dhcpd.pidto /var/lib/dhcp/var/ 
run/dhcpd.pid. During a cluster upgrade from OES 11 to OES 11 SP1, you must modify the location 
of the dhcpd. pid file in the DHCP cluster resource’s unload script. After you modify the script, you 
should bring the resource online only on OES 11 SP1 nodes. This is necessary to ensure a graceful 
shutdown of the dhcpd. pid process when the DHCP resource fails over to a different node. See 
“Path Change for dhcpd.pid” and “Changing the Path for dhcpd.pid” in the OES 11 SP3: Novell DNS/ 
DHCP Services for Linux Administration Guide. 


Upgrade Issues for OES 11 SP2 


There are no known upgrade issues from OES 11 SP1 to OES 11 SP2. 
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Upgrading Clusters from OES 2 SP3 to 
OES 11 SPx 


This section describes how to upgrade a Novell Cluster Services cluster and the file system 
resources from Novell Open Enterprise Server (OES) 2 SP3 to OES 11 SP1, to OES 11 SP2, or to 
OES 11 SP3. See the individual service guides for information about converting cluster resources. 


IMPORTANT: You can upgrade a cluster from OES 2 SP3 to OES 11 SP1, to OES 11 SP2, or to OES 
11 SP3 The same release version of OES must be installed and running on each new or upgraded 
node in the cluster. 


The procedures in this section refer to OES 11x. A specific version of OES 11 is mentioned only if the 
procedure applies only to that version of the platform. 


¢ Section 7.1, “What’s New and Changed for Clustered Storage,” on page 105 
¢ Section 7.2, “Supported Upgrade Paths from OES 2 SP3 to OES 11x,” on page 107 


¢ Section 7.3, “Requirements and Guidelines for Upgrading Clusters from OES 2 SP3,” on 
page 108 


¢ Section 7.4, “Adding OES 11x Nodes to an OES 2 SP3 Cluster (Rolling Cluster Upgrade),” on 
page 109 


¢ Section 7.5, “Updating the Clusters Plug-in for Novell iManager,” on page 112 


¢ Section 7.6, “Upgrading a Cluster with DST Resources from OES 2 SP3 to OES 11x,” on 
page 112 


What’s New and Changed for Clustered Storage 


Beginning in OES 11, Novell Cluster Services supports the following file system resources: 


¢ Section 7.1.1, “NSS Pools,” on page 105 
¢ Section 7.1.2, “Linux POSIX File Systems on an EVMS CSM (Compatibility Only),” on page 106 
¢ Section 7.1.3, “Linux POSIX File Systems on an LVM Volume Group,” on page 107 


NSS Pools 


Novell Cluster Services supports NSS pools. In a mixed-mode cluster, existing NSS pool cluster 
resources can be cluster migrated to any node in the cluster. 


NSS pools are managed by different storage managers on each platform, as shown in Table 7-1. Ina 
mixed-mode cluster with older operating systems, the OES 11 (or later) nodes are not able to 
recognize storage management actions performed on a pool on the alternate management system. 
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Table 7-1 Storage Managers for NSS Pools 


Platform Storage Manager 

OES 11 and later Novell Linux Volume Manager (NLVM) 

OES 2 SP3 Enterprise Volume Management System (EVMS) 
NetWare 6.5 SP8 Media Manager 


In NetWare 6.5 SP8 and OES 2 SP3, NSS management tools recognize only DOS devices that are 
up to 2 TB in size. In OES 11 and later, the NSS management tools can initialize a device to use the 
DOS partition table scheme or GUID partition table (GPT) scheme. DOS supports device sizes up to 
2 TB. GPT supports device sizes of any size, which allows you to create NSS pools up to 8 TB 
(terabytes) in size on a single device. In a mixed-mode cluster, the older platforms do not recognize 
devices that are partitioned with the GPT partitioning scheme. 


WARNING: In a mixed-mode cluster, do not perform any storage management actions (create, 
modify, or delete) for NSS pools while OES 11 (or later) nodes are active in the cluster. Any such 
action can result in data corruption. 


You must not perform storage management actions on pools while the cluster is in mixed mode. Wait 
to create new NSS pools until after all of the nodes in the cluster are upgraded. If it is necessary to 
create, modify, or delete a pool as part of a documented cluster resource upgrade process, you must 
shut down the OES 11x nodes, create the NSS pool cluster resource on the older nodes, then restart 
the upgraded nodes. This allows the upgraded nodes to see the new configuration. This is critical so 
that pools are able to cluster migrate across platforms, and to prevent possible corruption. 


For information about creating and managing NSS pool cluster resources on OES 11 or later, see 
Chapter 12, “Configuring and Managing Cluster Resources for Shared NSS Pools and Volumes,” on 
page 237. 


Linux POSIX File Systems on an EVMS CSM (Compatibility 
Only) 


Novell Cluster Services for OES 11 and later provides compatibility support for Linux POSIX file 
systems that were created by using the Cluster Segment Manager (CSM) in EVMS (Enterprise 
Volume Management System). 


For OES 2 SP3, Novell Cluster Services provided a Cluster Segment Manager (CSM) for EVMS to 
support cluster resources for Linux POSIX file systems. EVMS was deprecated in the SUSE Linux 
Enterprise Server (SLES) 11 release, and is no longer available. Accordingly, Novell Cluster Services 
provides compatibility support for these cluster resources. It has been modified in the following ways 
to allow you to move clustered Linux POSIX file systems from OES 2 SP3 to OES 11 and later: 


¢ Recognizes and supports the EVMS-based file system structure. 


+ Provides a way for managing a resource in the load, unload, and monitor scripts that works with 
the EVMS device and segment structure. 


+ Changes the device path from /dev/evms/ to /dev/mapper/, which is the same location where 
LVM devices are stored. 


Before any of the new OES 11x nodes join an OES2 SP3 cluster, you must offline all resources that 
use Linux POSIX volumes. Modify their load, unload, and monitor scripts to use the new commands 
for compatibility mode. Allow some OES 11x nodes to join the OES 2 SP3 cluster, then modify each 
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resources’ preferred nodes list to use only the OES 11x nodes in the cluster. Ensure that you disable 
Resource Follows Master setting for the resource until the conversion is finalized. After a resource’s 
scripts and preferred nodes list have been modified, you can bring the resource online only on OES 
11x nodes. As you add other OES 11x nodes, you can add those to the preferred nodes lists for 
failover. 


After a resource has been moved from an OES 2 SP3 node to an OES 11x node, it is not supported 
to move it back to an OES 2 SP3 node. The resource should fail over only to other OES 11x nodes in 
a mixed cluster. 


In the NSS management tools, the CSM layer is reported in the Details page for the shared device. 
This allows you to recognize the difference between the Linux POSIX resources that were created 
with EVMS and the new Linux LVM volume group resources that are created on OES 11x. 


For information about managing CSM cluster resources on OES 11 and later servers, see 
Chapter 14, “Upgrading and Managing Cluster Resources for Linux POSIX Volumes with CSM 
Containers,” on page 399. 


Linux POSIX File Systems on an LVM Volume Group 


Beginning in OES 11, Novell Cluster Services supports Linux POSIX file systems on Linux Volume 
Manager (LVM) volume groups, including Btrfs, Ext2, Ext3, ReiserFS, and XFS. For information about 
the file systems, see the “Overview of Linux POSIX File Systems” in the OES 11 SP3: Linux POSIX 
Volume Administration Guide. 


IMPORTANT: You should not create new Linux POSIX cluster resources while the cluster is in mixed 
mode, except as part of a documented conversion procedure. 


The LVM-based cluster resources can be used on OES 11 or later nodes in a mixed-mode cluster. 
The resource must not be moved to a node running the older platform. Ensure that you set up your 
preferred nodes for failover so that the LVM volume group cluster resource fails over only to the 
nodes running the new platform in a mixed-mode cluster. 


Beginning in OES 11 SP1, NSSMU and Novell Linux Volume Manager (NLVM) commands can be 
used to create cluster enabled LVM volume group cluster resources. See Chapter 13, “Configuring 
and Managing Cluster Resources for Shared LVM Volume Groups,” on page 327. 


Linux LVM management tools are also available in the YaST Expert Partitioner and in native Linux 
LVM command line commands. For information about using Linux commands to create a shared LVM 
volume group and cluster enabling it for Novell Cluster Services, see Section 13.4.1, “Creating a 
Shared LVM Volume with LVM Commands,” on page 353. 


Supported Upgrade Paths from OES 2 SP3 to OES 
11x 


The following upgrade paths are supported from OES 2 to OES 11: 


From this OES 2 platform To this OES 11 platform 


OES 2 SP3 on SUSE Linux Enterprise Server 10 SP3 OES 11 SP1 on SUSE Linux Enterprise Server 11 SP2 


OES 2 SP3 on SUSE Linux Enterprise Server 10 SP4 OES 11 SP1 on SUSE Linux Enterprise Server 11 SP2 


OES 2 SP3 on SUSE Linux Enterprise Server 10 SP3 OES 11 SP2 on SUSE Linux Enterprise Server 11 SP3 
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From this OES 2 platform To this OES 11 platform 


OES 2 SP3 on SUSE Linux Enterprise Server 10 SP4 OES 11 SP2 on SUSE Linux Enterprise Server 11 SP3 


OES 2 SP3 on SUSE Linux Enterprise Server 10 SP3 OES 11 SP3 on SUSE Linux Enterprise Server 11 SP4 


OES 2 SP3 on SUSE Linux Enterprise Server 10 SP4 OES 11 SP3 on SUSE Linux Enterprise Server 11 SP4 


7.3 Requirements and Guidelines for Upgrading 
Clusters from OES 2 SP3 


In addition to the Chapter 4, “Planning for Novell Cluster Services,” on page 47, consider the 
following rules and recommendations when upgrading from OES 2 SP3: 


+ Mixed-mode clusters should be considered a temporary configuration that exists only during an 
upgrade. 


+ Adding anew OES 2 SP3 cluster node to a mixed-mode cluster is not supported. 


¢ Linux POSIX cluster resources on OES 2 SP3 nodes must be taken offline before you allow any 
of the OES 11x nodes to join the cluster. 


Before bringing a resource online again, ensure that you modify its scripts for compatibility mode 
and configure its preferred nodes list to ensure that it is loaded on and fails over to only OES 11x 
nodes. You should also disable the Resource Follows Master settings until after the cluster 
conversion is finalized. For instructions, see Chapter 14, “Upgrading and Managing Cluster 
Resources for Linux POSIX Volumes with CSM Containers,” on page 399. 


+ After OES 11x nodes are added to the OES 2 SP3 cluster, the Linux POSIX cluster resources 
must be mounted on and fail over to only OES 11x nodes. 


+ NSS pool cluster resources can fail over to any node in the mixed-mode OES 2 SP3 and OES 
11x cluster. 


+ No storage management functions should be executed while a cluster is in mixed-mode unless 
you must do so as part of the documented upgrade process. Do not attempt to create, delete, 
expand, or modify the properties for partitions, pools, or volumes for any shared resources in the 
cluster. 


IMPORTANT: If it is necessary to create, modify, or delete a pool as part of a documented 
cluster resource upgrade process, you must shut down the OES 11x nodes, create the NSS pool 
cluster resource on an OES 2 SP3 node, then restart the OES 11x nodes. This allows the OES 
11x nodes to see the new configuration. This is critical so that pools are able to migrate, and to 
prevent possible corruption. 


+ You should not create new LVM volume group cluster resources in a mixed-mode cluster. Wait 
until after the cluster upgrade is completed. 


+ LVM2 wasn't the default volume manager on OES 2 SP3 and new features of LVM2 are only 
available on OES 11X, we suggest administrators don't modify LVM2 metadata, such as creating 
and expanding volumes, before all nodes are running OES 11. 
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1.4 


Adding OES 11x Nodes to an OES 2 SP3 Cluster 
(Rolling Cluster Upgrade) 


Performing a rolling cluster upgrade from OES 2 SP3 to OES 11x lets you keep your cluster up and 
running and lets your users continue to access cluster resources while the upgrade is being 
performed. 


During a rolling cluster upgrade, one OES 11x server is added at a time, either by adding a new node 
or upgrading an OES 2 SP3 node: 
+ Add an OES 11x node and migrate resources to it. 


+ Remove (cluster leave command) an OES 2 SP3 node, upgrade it to OES 11x, return it to the 
cluster, and migrate resources to it. 


After all desired OES 11x nodes are present in the cluster, remove any remaining OES 2 SP3 nodes 
that will not be upgraded, migrating their resources to OES 11x nodes. You should complete the 
upgrade as soon as possible. Don’t leave the cluster in a mixed-mode state for an extended period. 


To perform a rolling cluster upgrade: 


1 Make a note of the OES components that are installed on the OES 2 SP3 cluster nodes. 


You will probably want to install the same OES components on the OES 11x nodes that you add 
to the cluster. 


2 Prepare some OES 11x nodes for the cluster, but do not allow them to join the cluster. 


IMPORTANT: If you are upgrading an OES 2 SP3 cluster node to OES 11x, leave the cluster 
before the upgrade and do not rejoin until Step 4. 


2a Install SLES and the desired OES Services, including Novell Cluster Services, but do not 
configure the node for the cluster at this time. 


2b Verify that the server is functioning properly. 


2c In YaST, go to the Novell Cluster Services Configuration page as described in Section 5.5.4, 
“Accessing the Novell Cluster Services Configuration Page in YaST,” on page 82. 


2d Configure the node for the existing OES 2 SP3 cluster as described in Section 5.5.6, 
“Adding a Node to an Existing Cluster,” on page 88. 


Parameter Action 
LDAP administrator user password Specify the password of the user name shown, then click 
OK. 


Typically, this is the LDAP administrator identity that was 
used when the OES Services were installed, or the identity 
configured after the install in Section 5.5.3, “Using Different 
LDAP Credentials for the Cluster Configuration,” on 

page 82. 


New or existing cluster Select Existing Cluster. 
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Parameter Action 


Directory Server Address Select the check box next to the IP address of the LDAP 
server you want to use as the default for this node. The 
local LDAP server is selected by default. 


You can add, remove, or change the order of available 
LDAP servers for the node after the setup is complete. See 
Section 8.13.1, “Changing the Administrator Credentials or 
LDAP Server IP Addresses for a Cluster,” on page 143. 


Cluster FDN Click Browse, navigate the tree to select the existing 
Cluster object for the OES 2 SP3 cluster, click OK, then 
click Next. 

NCS Proxy User Name Specify one of the following users as the NCS Proxy user 


for this server, then click Next: 


+ OES Common Proxy User (default if it was configured 
for the server) 


+ LDAP Admin User 


+ Another Administrator User 


IP address of this node From the drop-down list, select the IP address that Novell 
Cluster Services will use for this node. 


Start Cluster Services now Deselect the check box. 


Do not start cluster services on this node or join the cluster 
until Step 4, after all of the Linux POSIX cluster resources 
have been taken offline. 


2e Click Finish, review the summary, then click Next to complete the configuration. 
2f Click Finish to close the OES Configuration dialog box. 


3 Oneach OES 2 SP3 node, prepare each of the existing Linux POSIX cluster resources for OES 
11x by doing the following: 


3a Take the Linux POSIX cluster resource offline. 
3b Disable the Resource Follows Master option for the resource. 
3c Modify the resource’s load, unload, and monitor scripts. 


Use one of the following methods to prepare the resource, depending on how it is 
configured: 


+ Cluster Segment Manager: If the Linux POSIX volume is built directly on the Cluster 
Segment Manager, follow the procedure in Section 14.4, “Modifying the Scripts for 
CSM Resources without a Segment Manager,” on page 402. This is the typical 
configuration in OES 2 SP3. 


+ Cluster Segment Manager plus Another Segment Manager: If one or multiple 
Linux POSIX volumes are built on a Segment manager on top of the Cluster Segment 
Manager, follow the procedure in Section 14.5, “Modifying the Scripts for CSM 
Resources with a Segment Manager,” on page 407. This is an optional configuration in 
OES 2 SP3 that is rarely used. 


3d Modify other resource policy settings as desired, but do not enable the Resource Follows 
Master option. 
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3e Do not bring a Linux POSIX resources online until you are ready to do so in Step 5b, after its 
Preferred Nodes list has been modified to use only OES 11x nodes. 


3f Repeat Step 3a to Step 3e for each Linux POSIX cluster resource. 


4 For each of the new OES 11x nodes, start Novell Cluster services manually by using one of the 
following methods, and allow the node to join the OES 2 SP3 cluster. 


¢ Reboot the cluster server. 

+ Ata command prompt, go to the /etc/init.d directory, then enter the following as the 
root user: 
./novell-nes start 

+ Ata command prompt, enter the following as the root user: 


renovell-nes start 


5 For each of the Linux POSIX cluster resources in turn, do the following: 


5a In iManager, modify the resource’s Preferred Nodes list to include only OES 11x nodes as 
described in Section 14.7, “Configuring the Preferred Nodes and Cluster Settings fora CSM 
Cluster Resource,” on page 415. 


5b In iManager, bring the resource online on its first preferred node. Click Clusters > My 
Clusters, then select the cluster. On the Cluster Manager page, select the resource object, 
then click Online. 


You can also use the cluster online command. Open a terminal console as the root 
user, then enter 


cluster online <resource_name> <node_name> 


5c Verify that the resource and any related services are working properly for the resource. 
5d Repeat Step 5a to Step 5c for each Linux POSIX cluster resource. 


6 If you add more OES 11x nodes, ensure that you modify the Preferred Nodes list accordingly for 
each of the Linux POSIX cluster resources. 


7 For each of the existing OES 2 SP3 cluster nodes that you want to upgrade to OES 11x: 
7a Log in to the node as the root user, then open a terminal console. 
7b Use the cluster leave command to remove the node from the cluster. 


Any cluster resources that were running on the server should fail over to another server in 
its preferred nodes list. 


You can also manually cluster migrate the resources to another server in the cluster prior to 
bringing down the server. 


7c Stop Novell Cluster Services by entering 
renovell-ncs stop 
7d Apply the OES 11x and Novell Cluster Services upgrade, and fully patch the system. 
7e Start Novell Cluster Services by entering 
renovell-necs start 
7f Use the cluster join command to rejoin the node to the cluster. 
7g Modify the Preferred Nodes list accordingly for each of the cluster resources. 


7h Repeat these steps for each OES 2 SP3 node that you want to upgrade. 
8 Bring down each of the OES 2 SP3 cluster nodes that you want to remove from the cluster. 
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Any cluster resources that were running on the server should fail over to another server in its 
preferred nodes list. 


You can also manually migrate the resources to another server in the cluster prior to bringing 
down the server. 


9 After the last cluster resource has been moved to the OES 11x nodes and all OES 2 SP3 nodes 
have left the cluster, the conversion is complete. 


7.5 Updating the Clusters Plug-in for Novell iManager 


Beginning in OES 11 SP1, the Clusters plug-in replaces the Cluster Manager, BCC Manager, Cluster 
Event Log, and Cluster Options menu options with the My Clusters and My Resources options. The 
former menu options appear as tabs when you select a cluster from the My Clusters page. The plug- 
in is updated automatically to show new tasks, and hide old ones. However, the Role-Based Services 
role for Clusters is not updated automatically. 


If you use Role-Based Services, the Clusters plug-in must be updated manually on the Role-Based 
Services Configuration page in order to pick up the modified menu options. See Section 5.7, 
“Installing or Updating the Clusters Plug-in for iManager,” on page 93. 


7.6 Upgrading a Cluster with DST Resources from 
OES 2 SP3 to OES 11x 


You can upgrade a cluster from OES 2 SP3 to OES 11 SP1 or from OES 2 SP3 to OES 11 SP2. The 
same release version of OES 11 must be installed and running on each new or upgraded node in the 
cluster. 


The procedure in this section refers to OES 11x. A specific version of OES 11 is mentioned if the 
procedure applies only to that version of the platform. 


If you replace an OES 2 SP3 node with an OES 11x node instead of using an in-place upgrade to 
OES 11x, you must manually configure the global policies and move the All Shadowed Volumes 
policies data to the OES 11x node. 


1 On the replacement OES 11x node, set the same global configuration policies that are set on the 
OES 2 SP3 nodes. 


2 If you have All Shadowed Volumes policies set on the OES 2 SP3 nodes, copy the information in 
the /usr/novell/sys/. NETWARE/shadow_policy.xml file to the same path on the 
replacement OES 11x nodes. 


3 In iManager, use the Clusters plug-in to modify the preferred nodes list for each DST pool cluster 
resource to specify only OES 11x nodes as fail-over candidates. 


4 Launch a terminal console, then cluster migrate the DST pool cluster resource to an OES 11x 
node: 


cluster migrate <dst_volume_cluster_resource> [oes11x_node_name] 


If the node name is not specified, the resource automatically is brought online on an available 
node in its preferred nodes list. To bring it online on a specific node, you can specify a node in its 
preferred nodes list. The resource will be mounted there if it is possible to do so; that is, if the 
node is available and there are no resource conflicts. 
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Configuring Cluster Policies, Protocols, 
and Properties 


After installing Novell Cluster Services on one or more nodes in a cluster, you can configure the 
settings for the cluster to meet your needs and help you manage the cluster effectively. This 
additional configuration might consist of changing the values on some of the properties for the Cluster 
object. 

¢ Section 8.1, “Understanding Cluster Settings,” on page 113 

¢ Section 8.2, “Setting Up a Personalized List of Clusters to Manage,” on page 117 

¢ Section 8.3, “Selecting a Cluster to Manage,” on page 121 

¢ Section 8.4, “Configuring Quorum Membership and Timeout Policies,” on page 124 

¢ Section 8.5, “Configuring Cluster Protocols,” on page 125 

¢ Section 8.6, “Configuring Cluster Event Email Notification,” on page 127 

¢ Section 8.7, “Configuring Cascade Failover Prevention,” on page 129 

¢ Section 8.8, “Configuring NCS to Monitor the eDirectory Daemon (ndsd),” on page 132 

¢ Section 8.9, “Configuring the Cluster Node Reboot Behavior,” on page 135 

¢ Section 8.10, “Configuring STONITH,” on page 136 


¢ Section 8.11, “Viewing or Modifying the NCS Proxy User Assignment in the NCS Management 
Group,” on page 138 


¢ Section 8.12, “Viewing or Modifying the Cluster Master IP Address or Port,” on page 139 


¢ Section 8.13, “Moving a Cluster, or Changing the Node IP Addresses, LDAP Servers, or 
Administrator Credentials for a Cluster,” on page 143 


¢ Section 8.14, “What's Next,” on page 150 


8.1 Understanding Cluster Settings 


IMPORTANT: You must perform all Cluster Services configuration operations on the master node in 
the cluster. In iManager, select the Cluster object, not the Cluster Node objects. 


¢ Section 8.1.1, “Cluster Policies,” on page 114 

¢ Section 8.1.2, “Cluster Priorities,” on page 115 

¢ Section 8.1.3, “Cluster Protocols,” on page 115 

¢ Section 8.1.4, “RME Groups,” on page 116 

¢ Section 8.1.5, “BCC,” on page 116 

¢ Section 8.1.6, “Cascade Failover Prevention,” on page 116 

¢ Section 8.1.7, “Monitoring the eDirectory Daemon,” on page 116 
¢ Section 8.1.8, “Cluster Node Reboot Behavior,” on page 116 

¢ Section 8.1.9, “STONITH,” on page 117 


¢ Section 8.1.10, “Cluster Information,” on page 117 
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8.1.1 Cluster Policies 


Cluster policies are configuration settings that determine how a cluster is accessed, how many nodes 
are needed to form a quorum on startup, and if email notifications are sent. You can manage cluster 
policies in iManager by going to Clusters > My Clusters, selecting a cluster, then selecting Action > 

Edit Properties > Policies. Table 8-1 describes the configurable cluster policies: 


Table 8-1 Cluster Policies 


Property Description 
Cluster IP address Specifies the IP address for the cluster. 


You specify the IP address when you install Novell Cluster Services on the first 
node of the cluster. The IP address is bound to the master node and remains with 
the master node regardless of which server is the master node. 


Rarely, you might need to modify this value. See Section 8.12, “Viewing or 
Modifying the Cluster Master IP Address or Port,” on page 139. 


IMPORTANT: If you modify the master IP address, you must restart the cluster, 
exit iManager, then re-launch iManager before iManager can continue to manage 
the cluster. 


Port Specifies the port used for cluster communication. 


The default cluster port number is 7023, and is automatically assigned when the 
cluster is created. You might need to modify this value if there is a port conflict. 

You can change the port number to any other value that does not cause a conflict. 
See Section 8.12, “Viewing or Modifying the Cluster Master IP Address or Port,” 


on page 139. 
Quorum membership - Specifies number of nodes that must be up and running in the cluster before 
Number of nodes clusters begin to load. 


Specify a value between 1 and the number of nodes. Set this value to a number 
greater than 1 so that all resources are not automatically loaded on the first server 
that is brought up in the cluster. For example, if you set the membership value to 
4, there must be four serves up in the cluster before any resource will load and 
start. 


For instructions, see Section 8.4, “Configuring Quorum Membership and Timeout 
Policies,” on page 124. 


Quorum timeout Specifies the maximum amount of time to wait for the specified quorum to be met. 
If the timeout period elapses before a quorum is achieved, resources 
automatically begin loading on whatever number of nodes are actually up and 
running in the cluster. 


You can specify the time in seconds or minutes. 


For instructions, see Section 8.4, “Configuring Quorum Membership and Timeout 
Policies,” on page 124. 
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Property Description 


Email notification Enables or disables email notification for the cluster. If it is enabled, you can 
specify up to eight administrator email addresses for cluster events notification. 


Specifies the type of cluster events for notifications. You can receive notifications 
for only critical events such as node failure or a resource going comatose, or you 
can receive notifications for all cluster state changes and resource state changes. 


Specifies whether to receive messages in XML format. XML format messages 
can be interpreted with a parser and formatted to customize the message 
information for your specific needs. 


For instructions, see Section 8.6, “Configuring Cluster Event Email Notification,” 
on page 127. 


8.1.2 Cluster Priorities 


Cluster priorities determine the load priority of individual cluster resources. You can manage cluster 
resource priorities in iManager by going to the Clusters > My Clusters, selecting a cluster, then 
selecting Action > Edit Properties > Priorities. See Section 10.11, “Configuring Resource Priorities 
for Load Order,” on page 218. 


8.1.3 Cluster Protocols 


Table 8-2 describes the configurable cluster protocols properties that govern inter-node 
communication transmission and tolerances. You can manage cluster protocols policies in iManager 
by going to the Clusters > My Clusters, selecting a cluster, then selecting Action > Edit Properties > 
Protocols. See Section 8.5, “Configuring Cluster Protocols,” on page 125. 


Table 8-2 Cluster Protocols 


Property Description 


Heartbeat Specifies the interval of time in seconds between signals sent by each of the non- 
master nodes in the cluster to the master node to indicate that it is alive. The 
default is 1 second. 


Tolerance Specifies the maximum amount of time in seconds that a master node waits to get 
an alive signal from a non-master node before considering that node to have 
failed and removing it from the cluster. The default is 8 seconds. 


Master watchdog Specifies the interval of time in seconds between alive signals sent from the 
master node to non-master nodes to indicate that it is alive. The default is 1 
second. 


Modify this parameter setting only when supervised by Novell Technical Support 
(http://www.novell.com/support). 


Slave watchdog Specifies the maximum amount of time in seconds that the non-master nodes 
wait to get an alive signal from the master node before considering that the 
master node has failed, assigning another node to become the master node, and 
removing the old master node from the cluster. The default is 8 seconds. 


Modify this parameter setting only when supervised by Novell Technical Support 
(http://www.novell.com/support). 
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8.1.4 


8.1.5 


8.1.6 


8.1.7 


8.1.8 


Property Description 


Maximum retransmits This value is set by default and should not be changed. The default is 30. 


RME Groups 


The Resource Mutual Exclusion (RME) Groups page allows you to view or define sets of resources 
that must not run on the same node at the same time. You can manage RME Groups in iManager by 
going to the Clusters > My Clusters, selecting a cluster, then selecting Action > Edit Properties > 
RME Groups. See Section 10.12, “Configuring Resource Mutual Exclusion Groups,” on page 219. 


BCC 


If Novell Business Continuity Clustering (BCC) is installed in the cluster, the BCC properties page 
allows you to view or change policies for the selected cluster. You can manage BCC policies in 
iManager by going to Clusters > My Clusters, selecting a cluster, then selecting Action > Edit 
Properties > BCC. See the Novell Business Continuity Clustering website (http://www.novell.com/ 
documentation/bcc/). 


Cascade Failover Prevention 


Novell Cluster Services added the cascade failover prevention function that detects if a node has 
failed because of a bad cluster resource and prevents that bad resource from failing over to other 
servers in the cluster. It is enabled by default. See Section 8.7, “Configuring Cascade Failover 
Prevention,” on page 129. 


Monitoring the eDirectory Daemon 


Some clustered services rely on the eDirectory daemon (ndsqd) to be running and available in order to 
function properly. Beginning in OES 11 SP2, NCS provides the ability to monitor the status of the 
eDirectory daemon (ndsd) at the NCS level. It is disabled by default. The monitor can be set 
independently on each node. On a node, if the eDirectory daemon does not respond to a status 
request within a specified timeout period, NCS can take one of three configurable actions: an ndsd 
restart, a graceful node restart, or a hard node restart. See Section 8.8, “Configuring NCS to Monitor 
the eDirectory Daemon (ndsd),” on page 132. 


Cluster Node Reboot Behavior 


The Novell Cluster Services reboot behavior conforms to the kernel panic setting for the Linux 
operating system. By default the kernel panic setting is set for no reboot after a node shutdown. On 
certain occasions, you might want to prevent a downed cluster node from rebooting so you can 
troubleshoot problems. To control the cluster node reboot behavior, you can use the directive 
kernel .panic in the Linux /etc/sysct1.conf file to prevent a reboot, or to allow an automatic 
reboot and to specify the number of seconds to delay the reboot. See Section 8.9, “Configuring the 
Cluster Node Reboot Behavior,” on page 135. 
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8.1.9 


8.1.10 


8.2 


8.2.1 


STONITH 


The STONITH (shoot-the-other-node-in-the-head) capability allows Novell Cluster Services to kill a 
suspect node by using remote power control. Unlike a poison pill, it does not require a response from 
the suspect node. STONITH is used after a poison pill is issued; it does not replace the poison pill. 
See Section 8.10, “Configuring STONITH,” on page 136. 


Cluster Information 


After you install Novell Cluster Services, you use the Open Enterprise Server > OES Install and 
Configuration tool in YaST to set up the cluster or to add a node to an existing cluster. The YaST- 
based configuration is not used to modify the settings for an existing cluster. For information about 
modifying the settings for an existing cluster, see: 


¢ Section 8.11, “Viewing or Modifying the NCS Proxy User Assignment in the NCS Management 
Group,” on page 138 
¢ Section 8.12, “Viewing or Modifying the Cluster Master IP Address or Port,” on page 139 


¢ Section 8.13, “Moving a Cluster, or Changing the Node IP Addresses, LDAP Servers, or 
Administrator Credentials for a Cluster,” on page 143. 


Setting Up a Personalized List of Clusters to 
Manage 

The My Clusters page in the Clusters plug-in for iManager allows each cluster administrator to set up 
a personalized list of clusters to manage. This allows an administrator to view at a glance the status 


of the specified clusters. The list persists between the administrator's logins to the same iManager 
server. 


Your personalized list of clusters and display preferences are saved on the iManager server in the 
following location: 


/var/opt/novell/iManager/nps/WEB-INF/config/NDS<tree_name>- 
<user name_and_context_without_dots>/ncs.xml 


For example, for tree AVALONTREE and user admin.nove1l, the file path is: 
/var/opt/novell/iManager/nps/WEB-INF/config/NDSAVALONTREE-adminnovell/ncs.xml 
The following sections describe how manage the list of clusters and to personalize the display. 


¢ Section 8.2.1, “Adding Clusters to Your My Clusters List,” on page 117 
¢ Section 8.2.2, “Viewing Information about Clusters in Your My Clusters List,” on page 118 
¢ Section 8.2.3, “Personalizing the My Clusters Display,” on page 119 


¢ Section 8.2.4, “Removing Clusters from a My Clusters List,” on page 121 


Adding Clusters to Your My Clusters List 


1 Log in to iManager as a cluster administrator. 
2 In Roles and Tasks, select Clusters > My Clusters. 


The list is initially empty. 
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( Roles and Tasks 
[All Categories] x 


Archive Versioning 


Clusters 
My Clusters 


DHCP (OES Linux) 


My Clusters 


[2] 


The list below provides a convenient way to keep track of clusters you frequently manage. Click on the add button to browse for clusters in the 


tree, and select them to be added to the list 


Add Remove Action ~ Refresh 


[E] Status Name 


The list is empty. Click the Add button to browse for and select one or more clusters 


Master Node 


3 Click Add to open the eDirectory browser pop-up window. 


IP Address Nodes Epoch BCC 


4 Browse the tree where you are currently logged in to locate and select one or more Cluster 


objects, then click OK. 


Newly selected clusters are added to your personalized list. 


A] Roles and Tasks 


[All Categories] x 


My Clusters 


My Resources 


My Clusters 


a 


The list below provides a convenient way to keep track of clusters you frequently manage. Click on the add button to browse for 
clusters in the tree, and select them to be added to the list. 


My Clusters 


Add Remove Action~ Refresh 


Status Name 
@ cluster1 
@ § duster2 
@ Fclustd 


Master Node 


bcclab-aa1 


bcclab-bb1 


gs avalon 


IP Address Nodes Epoch BCC 
10.10.10.60 2/2 3 Y 
10.10.10.70 2/12 1 v 
10.10.10.134 212 1 


5 (Optional) Personalize the display as described in Section 8.2.3, “Personalizing the My Clusters 


Display,” on page 119. 


8.2.2 Viewing Information about Clusters in Your My Clusters List 


118 


1 Log in to iManager as a cluster administrator. 


2 In Roles and Tasks, select Clusters > My Clusters. 


The My Clusters page displays your personalized list of clusters in the tree. 


(© Roles and Tasks 


[All Categories] 5 


My Clusters 


[2] 


The list below provides a convenient way to keep track of clusters you frequently manage. Click on the add button to browse for 
clusters in the tree, and select them to be added to the list. 


My Clusters 


Add Remove Action Refresh 


Status Name 
@ > custert 
@ §$ custer2 
@ ge clusid 


Master Node 


bcclab-aat 


B bcclab-bb1 


B avalon 


IP Address Nodes Epoch BCC 
10.10.10.60 2/2 3 v 
10.10.10.70 2/2 1 Y 
10.10.10.134 2/12 1 


3 View the Status icon next to a Cluster object to understand the current overall state of the cluster. 


State Icon 


Normal @ 


Description 


The cluster is up and running. 
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State Icon Description 


Stopped 5 The cluster is stopped. Administrator intervention is needed. 

Critical x One or more nodes in the cluster have failed. Administrator intervention is 
needed. 

Warning <> An alert condition has occurred. A node or resource needs administrator 
attention. 

Unknown D The state of the cluster cannot be determined. 


4 The My Clusters list displays the following information about each cluster: 


Parameter Description 


Name The name assigned to the cluster. 


Distinguished Name (Not displayed by default) The dot-delimited fully distinguished name of the 
cluster, such aS clustername. context .domain. 


Master Node The name of the currently assigned master node for the cluster. 

IP Address The unique IP address that represents the cluster. 

Nodes The number of active nodes in the cluster. 

Epoch The number of times the cluster state has changed. The cluster state changes 


every time a server joins or leaves the cluster. 


BCC A check mark in this column indicates that the cluster is enabled for a Business 
Continuity Cluster (BCC). 


5 (Optional) Personalize the display as described in Section 8.2.3, “Personalizing the My Clusters 
Display,” on page 119. 


8.2.3 Personalizing the My Clusters Display 


The My Clusters page provides menus in the column headings that allow you to personalize the 
display. You can sort the entries, modify the columns, or filter the entries. 

1 Log in to iManager as a cluster administrator. 

2 In Roles and Tasks, select Clusters > My Clusters. 


3 Ifthe list is empty, you must add at least one cluster in order to be able to personalize the 
display. Select Add, browse to select the Cluster object, then click OK. 


4 Select Refresh, then choose a refresh rate that is long enough to allow you to view all items in 
the list. 


5 Click or mouse-over a column heading to activate its options, then click the arrow to access the 
menu for that column. 
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120 


6 Perform one of the available actions when you access the column’s menu. Some actions are not 
available for all fields. 


¢ Sort: Select Sort Ascending (A to Z) or Sort Descending (Z to A) to specify the preferred 


sort order. Cluster objects are sorted based on values in the selected column. Numbers are 
treated as text values and are sorted alphabetically, not numerically. 


My Clusters [2] 


The list below provides a convenient way to keep track of clusters you frequently manage. Click on the add button to browse for 
clusters in the tree, and select them to be added to the tist. 


My Clusters 


Add Remove Action+ Refresh 


E] Status Name Master Node 


Bcc 
A @ ge custo @ deciap-aat $4 sort ascending y 
F] e@ cluster? beclab-bb1 zl Sort Descending Y 
> 6 E Columns 
FB FH cusi R avalon 


+ Columns: Select Columns to display the parameters, select or deselect a parameter’s 


check box to add or remove the column, then press Enter to apply the changes. The 


parameters are described in Step 4 in Section 9.17, “Viewing the Cluster Node Properties,” 
on page 172. 


My Clusters [2] 


The list below provides a convenient way to keep track of clusters you frequently manage. Click on the add button to browse for 
clusters in the tree, and select them to be added to the list. 


My Clusters 


Add Remove Action- Refresh 
E] Status Name Master Node 
ĝe custert 6 beclab-aa7 $| sor ascending Y 
$ custerz RA Z| SortDescending Y 


0 A 
p ¢ 


a 
p 


ĝe cus10 


Name 
Distinguished Name 
Master Node 


IP Address 


Nodes 


Epoch 


ISS SSS80 S88 


Bcc 
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¢ Filter: Specify a filter to display only the Cluster objects with values that match. 


My Clusters 2 

The list below provides a convenient way to keep track of clusters you frequently manage. Click on the add button to browse for 

clusters in the tree, and select them to be added to the list 

My Clusters 

Add Remove Action+- Refresh 
Status Name Master Node ~ IPAddress Nodes Epoch Bcc 
© ĝo custert K beclab-aa1 O| Sort ascending 2/2 3 Y 
Ə > ‘ g b Z| SortDescending 2n z F 
E Columns 

© = Ze clus10 m ntan 22 1 


Fitters 


Enter fitter text 


To add or modify a column’s filter, select Filter, place the cursor in the Filter field, type the 
desired filter text, then press Enter to apply the filter. If a cluster’s parameter value matches 
the specified filter, the Cluster object and its information are displayed. 


To remove a column’s filter, select Filter, place the cursor in the Filter field, delete the filter 
text, then press Enter to refresh the display. The filter no longer applies for that column. 


8.2.4 Removing Clusters from a My Clusters List 


1 Log in to iManager as a cluster administrator. 
2 In Roles and Tasks, select Clusters > My Clusters. 


The My Clusters page displays your personalized list of clusters in the tree that you want to 
manage. 


3 Select the check box next to the cluster that you want to remove from your personalized list, then 
click Remove. 


The cluster is removed from your personalized list. This action does not delete the Cluster object 
or related objects. 


8.3 Selecting a Cluster to Manage 


1 Log in to iManager as a cluster administrator. 
2 In Roles and Tasks, select Clusters > My Clusters. 


The My Clusters page displays your personalized list of clusters in the tree that you want to 
manage. To add or remove clusters from your list, see Section 8.2, “Setting Up a Personalized 
List of Clusters to Manage,” on page 117. 


The Clusters plug-in sends a status query to the master IP address of each cluster in the list. 


3 If the master IP address of a cluster has connection problems, the Clusters plug-in allows you to 
use the server IP address of a node (preferably the master node) to manage the cluster and fix 
the problem. 


On the My Clusters page, if the cluster status query fails: 
3a Read the message about the problem connecting to the master IP address. 


The message appears each time that you revisit the My Clusters page until you resolve the 
IP address conflict on the network or by modifying the cluster’s master IP address. 
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Failed to retrieve status information 
about cluster clusl via master IP 
address 10,10,10.242, 


Do you wantto select a cluster node 
(preferably the master node) to manage the 
cluster? 


Please note that the selection will be 


temporary. You need to select again 
whenever "My Clusters" page loads. 


Please use this opportunity to fix the master 
IP address. 


3b Do one of the following: 


+ Use a server node (preferably the master): Click Yes to agree to use the server IP 
address of a node to temporarily manage the cluster. 


+ View error details: Click No to view the Cluster Communication Error details. It 
provides some tips for diagnosing the root cause of the IP address conflict. Click OK to 
dismiss the message. Try to resolve the conflict on the network, then select Clusters > 
My Clusters to see if the connection issue is resolved. 


& Error: Cluster Communication Error 


An error occurred while communicating between iManager and the CUMOM broker running on the cluster master node. 
Click the "More Info” button below for the full stack trace. 


Summary: 
Error: 316009-12 (BROKER_ERROR_NO_ROUTE_TO_HOST) - No route to host (10.10,10.242) 


Diagnosis: 


This error signals that a problem occurred while attempting to make a socket connection to the cluster at IP address: 

10.10.10.242 and port: 5989, Typically this error occurs because the IP address for the cluster cannot be reached 
from the iManager server possibly because of an intervening firewall, or if an intermediate router is down. It can also 
occur when the master IP address resource is down, or there are no nodes in the cluster. 


Suggestions: 
The following suggestions may help to further narrow down or resolve the problem: 


+ Verify the cluster IP address is correct: 10.10.10.242. First, check "NCS:Network Address” attribute and make 
sure the hex translates into the IP Address for the Master IP Resource, Next, check the "Network Address” 
attribute which has the TCP and UDP port 524 addresses for the Master IP Resource address as well. These 
addresses should match the "NCS:Network" address. If these addresses differ, manually change them to match. 
This could be the case if the IP address was ever changed on the cluster. 


Verify the ability to connect to the cluster master node by pinging the cluster IP address from a terminal on 
the iManager server. 

Confirm that the IP address for the "Master IP Address” Resource is bound to the master node. On the console, 
type: “ip addr show | grep secondary” and you should see it bound. The Master IP address needs to be the same 
in the cluster load and unload scripts, and in the attributes of the cluster object in "NCS:Network Address” and 
“Network Address” with UDP and TCP. 


+ If you are still getting this error, click the “More Info” button below, and copy and paste the contents in an 
email to Novell Technical Support. 


OK | _ More Info 
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3c Browse to choose the node (preferably the master node) to use to temporarily manage the 
cluster, then click OK. 


Browse Search 
Contents: jbt-cictt carta seecten range) 
Look in: 


novel Eanan 
(Geovepde: rostl) r"a 
a 


Look for objects named: _ 
(Seaweyde: A” Law”, fate 


Look tor these types 
NOP Sever 


Atare Bosena 
Lead Coppin 


ie Cwis 


trn text D 


Selected Objects: 1 Kich object ureei 


D spores 


on Ces Atl 


3d If you need to modify the master IP address to fix the connection problem, see Section 8.12, 
“Viewing or Modifying the Cluster Master IP Address or Port,” on page 139. 


4 After a successful connection to the cluster master IP address, do any of the following: 


¢ Cluster Properties: To view or manage the cluster policies, protocols, or properties, select 
the check box next to the cluster, then select Action > Edit Properties. 


The Cluster Properties dialog box opens. The browser’s pop-up blocker must be disabled. 
See the following: 


¢ Section 8.4, “Configuring Quorum Membership and Timeout Policies,” on page 124 
¢ Section 8.5, “Configuring Cluster Protocols,” on page 125 
¢ Section 8.6, “Configuring Cluster Event Email Notification,” on page 127 

¢ Resources: To manage cluster resources, click the cluster name link. 


The browser opens on the Cluster Manager page in the same browser window. See 
Chapter 10, “Configuring and Managing Cluster Resources,” on page 193. 


+ Cluster Report: To generate a report for the cluster, select the check box next to the 
cluster, then select Action > Run Report. 


The Cluster Report dialog box opens. The browser’s pop-up blocker must be disabled. See 
Section 9.9, “Generating a Cluster Configuration Report,” on page 165. 


+ Repair a NetWare Cluster: To repair a NetWare cluster, select the check box next to the 
cluster, then select Action > Repair. 


This option is useful if you are replacing an existing NetWare server. Install the NetWare 
operating system and Novell Cluster services on the new server, and name server with the 
same name as the old server. Choose the Repair option to automatically configure Novell 
Cluster Services on the replacement server. You must manually copy the 1dncs.nef and 
uldnes.ncf files from the sys:\system directory to this node from another node in the 
cluster. 


+ Repair an OES Linux Cluster: To repair an OES cluster, select the check box next to the 
cluster, then click Action > Repair. 
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The Repair option is useful when you see a mismatch in the cluster resource list or the 


resource priority list. The cluster repair will make the resource list consistent with the 
resource objects. 


For example, if the cluster status command output is blank or the deleted resources are still 
listed, the repair option will make the resource list match the resource objects. Resources 
will then be displayed properly in CLI and iManager. 


NCS logs the corresponding repair option messages in the /var/opt /novell/log/ncs/ 
repair.log file. 


8.4 Configuring Quorum Membership and Timeout 
Policies 


The quorum membership and timeout properties govern when cluster resources begin loading on 
cluster startup, failback, or failover. 


1 In iManager, select Clusters > My Clusters. 
2 Select the check box of the cluster that you want to manage. 


If the cluster does not appear in your list, add the cluster to your list as described in Section 8.2, 
“Setting Up a Personalized List of Clusters to Manage,” on page 117. 


3 Select Action > Edit Properties to open the Properties dialog box. 
4 Click the Policies tab. 


è clust.ncs.novell 2 


Priorities \ Protocols ` RME Groups \ Business Continuity 


viev 


r change cluster IP ad 


ort numbers, quorum triggers, and cluster email notification. Changing the 


IP address tt before iManager can continue to manage the cluster 
Cluster Information Notification 

IP Address | 10.10.10.134 CJ Enable Cluster Notification Events 
Port [z023 | EMail Addresses 


Quorum Triggers 
Timeout: [so | | Seconds c| © Receive Only Critical Events 


Number of Nodes: |1 | Verbose Messages 


Vi XML Messages 


OK | Cancel | Apply | 


5 Under Quorum Triggers, specify the number of nodes that are required to form a quorum for the 
specified cluster. 


See Section 8.4.1, “Quorum Membership (Number of Nodes),” on page 125. 


6 Under Quorum Triggers, specify the amount of time in seconds to wait for the quorum to form 
before beginning to load the cluster resources without a quorum being formed. 


See Section 8.4.2, “Quorum Timeout,” on page 125. 
7 Click Apply or OK to save your changes. 
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8.4.1 


8.4.2 


8.5 


8 Restart Cluster Services. Open a terminal console as the root user, then enter the following at 
the command prompt: 


renovell-nes restart 


Quorum Membership (Number of Nodes) 


A cluster quorum is the number of nodes that must be running in the cluster before resources begin to 
load. When you first bring up servers in your cluster, Novell Cluster Services reads the number 
specified in this field and waits until that number of servers is up and running in the cluster before it 
starts loading resources. 


Set this value to a number greater than 1 so that all resources do not automatically load on the first 
server that is brought up in the cluster. For example, if you set the Number of Nodes value to 4, there 
must be four servers up in the cluster before any resource loads and starts. 


Quorum Timeout 


Timeout specifies the amount of time to wait for the number of servers defined in the Number of 
Nodes field to be up and running. If the timeout period elapses before the quorum membership 
reaches its specified number, resources automatically start loading on the servers that are currently 
up and running in the cluster. For example, if you specify a Number of Nodes value of 4 and a timeout 
value equal to 30 seconds, and after 30 seconds only two servers are up and running in the cluster, 
resources begin to load on the two servers that are up and running in the cluster. 


The timeout is an attribute of the cluster. It gets initialized when the NCS modules are being loaded. If 
you change the value, restart Cluster Services (rcnovell-nes restart) to get the updated settings. 


Configuring Cluster Protocols 


The cluster protocols determine the transmit frequency and tolerance settings for all nodes in the 
cluster, including the master node. The master node is generally the first node brought online in the 
cluster, but if that node fails, any of the other nodes in the cluster can become the master. 


IMPORTANT: If you change any protocol properties, you should restart all servers in the cluster to 
ensure that the changes take effect. 


1 In iManager, select Clusters > My Clusters. 


2 In your personalized My Clusters list, select the check box next to the cluster you want to 
manage. 


If the cluster does not appear in your list, add the cluster to your list as described in Section 8.2, 
“Setting Up a Personalized List of Clusters to Manage,” on page 117. 


3 Click Action > Edit Properties to open the Properties dialog box. 
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8.5.1 


8.5.2 


4 Click the Protocols tab. 


The Protocols page allows you to view or change cluster protocol settings such as heartbeat, 
tolerance, master/slave watchdogs, and maximum retransmits. The Protocols page also lets you 
view the script used to configure the cluster protocol settings, but not to change it. Changes 
made to the protocols setting automatically update the scripts. 


è clus1.ncs.novell ? 
Policies \ Priorities f Protocols ' RME Groups \ Business Continuity 
View or change cluster protocol settings 
Heartbeat (seconds): |1 | Master Watchdog (seconds): |1 | 
Tolerance (seconds): [8 | Slave Watchdog (seconds): (8 | 
Maximum Retransmits [30 | 


Panning clusterid 1623659656 
heartbeat rate_usecs 1000000 
censustaker tolerance 8000000 
sequencer master_watchdog 1000000 
sequencer slave_watchdog 8000000 
sequencer retrans_max 30 


nodeid 137.65.67.37 0 


OK Cancel Apply 


5 Specify values for the cluster protocols properties. See the following: 


+ Heartbeat 

+ Tolerance 

+ Master Watchdog 

+ Slave Watchdog 

+ Maximum Retransmits 


6 Click Apply or OK to save changes. 


7 Restart all nodes in the cluster to make the changes take effect. 


Heartbeat 


Heartbeat specifies the amount of time between transmits for all nodes in the cluster except the 
master. For example, if you set this value to 1, non-master nodes in the cluster send a signal that they 
are alive to the master node every second. 


Tolerance 


Tolerance specifies the amount of time the master node gives all other nodes in the cluster to signal 
that they are alive. For example, setting this value to 4 means that if the master node does not 
receive an “I’m alive” signal from a node in the cluster within four seconds, that node is removed from 
the cluster. 
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8.5.3 


8.5.4 


8.5.5 


8.6 


8.6.1 


Master Watchdog 


Master Watchdog specifies the amount of time between transmits for the master node in the cluster. 
For example, if you set this value to 1, the master node in the cluster transmits an “I’m alive” signal to 
all the other nodes in the cluster every second. 


Modify this parameter setting only when supervised by Novell Technical Support (http:// 
www.novell.com/support). 


Slave Watchdog 


Slave Watchdog specifies the amount of time the master node has to signal that it is alive. For 
example, setting this value to 5 means that if the non-master nodes in the cluster do not receive an 
“I'm alive” signal from the master within five seconds, the master node is removed from the cluster 
and one of the other nodes becomes the master node. 


Modify this parameter setting only when supervised by Novell Technical Support (http:// 
www.novell.com/support). 


Maximum Retransmits 


This value is set by default, and should not be changed. 


Configuring Cluster Event Email Notification 


Novell Cluster Services can automatically send out email messages for certain cluster events like 
cluster and resource state changes or nodes joining or leaving the cluster. The subject line provides 
information about the cluster name, resource name, action taken, and node name. For example: 


CL1: POOL1 SERVER online on NODE1 


You can enable or disable email notification for the cluster and specify up to eight administrator email 
addresses for cluster notification. 


¢ Section 8.6.1, “Configuring an Email Port,” on page 127 
¢ Section 8.6.2, “Configuring the Notification Policies,” on page 128 


Configuring an Email Port 


Novell Cluster Services uses Postfix to send cluster email alerts, using the primary IP address. 
Postfix uses port 25 by default. If you have a cluster resource that uses SMTP (which also defaults to 
port 25), the port conflict between Postfix and SMTP can prevent that resource from working in the 
cluster. To avoid a port conflict, you can change the Postfix port configuration, or you can bind the 
clustered service to its resource’s secondary IP address. 


To configure Postfix to use a different port, you can edit the /etc/postfix/main.ct file and change 
the values for the inet_interfaces, mydestination, and mynetworks_ style directives. You can 
change the listen port for the smtpd process in the /etc/postf£ix/master.cf file. For more 
information about configuring Postfix, see the Postfix website (http://www. postfix.org/ 
documentation.html). 


To bind a service to its resource’s secondary IP address, refer to the cluster documentation for the 
service. For example, the GroupWise Internet Agent (GWIA) uses SMTP. Because both Postfix and 
the GWIA default to using port 25, you must configure the GWIA to bind exclusively to its resource’s 
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secondary IP address in order to avoid a port conflict between Postfix and the GWIA. For information 
about how to set up the secondary IP address and to bind the GWIA to it, see the following sections 


in the GroupWise 2012 Interoperability Guide (http://www.novell.com/documentation/groupwise2012/ 
gw2012_guide_interop/data/a20gkue.html): 


¢ “Selecting the GWIA Partition and Secondary IP Address” (http://www.novell.com/ 
documentation/groupwise2012/gw2012_guide_interop/data/bwe3bwa.html#bwe3bwk) 


+ “Forcing Use of the GWIA Secondary IP Address” (http://www.novell.com/documentation/ 
groupwise2012/gw2012_guide_interop/data/bwe3bx1.html#bwe3byz) 


8.6.2 Configuring the Notification Policies 


1 In iManager, select Clusters > My Clusters. 


2 In your personalized My Clusters list, select the check box next to the cluster you want to 
manage. 


If the cluster does not appear in your list, add the cluster to your list as described in Section 8.2, 
“Setting Up a Personalized List of Clusters to Manage,” on page 117. 


3 Click Action > Edit Properties to open the Properties dialog box. 
4 Click the Policies tab. 


è clust.ncs.novell Bl 


Priorities \ Protocols \ RME Groups \ Business Continuity 


email notification. Changing the 
e cluster 


Cluster Information Notification 
IP Address: | 10.10.10.134 | C Enable Cluster Notification Events 
Port {7023} EMail Addresses 
vell Hela 
Quorum Triggers 
Timeout: foo | [Seconds |¢ ® Receive Only Critical Events 


Number of Nodes l 


\ Verbose Messages 


M] XML Messages 


OK | Cancel | Apply | 


5 Under Notification, select or deselect the Enable Cluster Notification Events check box to 
enable or disable email notification. 


Notification 


M| Enable Cluster Notification Events 


EMail Addresses: 


| cluster@example.com ¢ |Œ eZ 


@ Receive Only Critical Events 


O Verbose Messages 


XML Messages 
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6 If you enable email notification, configure the notification settings: 
6a Add up to eight email addresses in the field provided. 


You can click the buttons next to the field to add, delete, or edit email addresses. Repeat 
this process for each email address you want on the notification list. 


Y Add item 


| alice@example.com | 


| @ cancel | | Bok 


6b Specify the type of cluster events you want administrators to receive messages for. 


¢ Only Critical Events: (Default) Select this option to receive notification only of critical 
events like a node failure or a resource going comatose. 


+ Verbose Messages: Select this option to receive notification of all cluster state 
changes including critical events, resource state changes, and nodes joining and 
leaving the cluster. 


6c Specify whether you want to receive notification of all cluster state changes in XML format 
by selecting the XML Messages option. 


XML is selected by default. XML format messages can be interpreted and formatted with a 
parser that lets you customize the message information for your specific needs. 


7 Click Apply or OK to save changes. 


8.7 Configuring Cascade Failover Prevention 


A cascading failover occurs when a bad cluster resource causes a server to fail, then fails over to 
another server causing it to fail, and then continues failing over to and bringing down additional 
cluster servers until possibly all servers in the cluster have failed. 


Novell Cluster Services provides a Cascade Failover Prevention function. It detects if a node has 
failed because of a bad cluster resource, and prevents that bad resource from failing over to other 
servers in the cluster. 

¢ Section 8.7.1, “Understanding the Cascade Failover Prevention Quarantine,” on page 129 

¢ Section 8.7.2, “Releasing a Resource from Quarantine,” on page 131 


¢ Section 8.7.3, “Enabling or Disabling Cascade Failover Prevention,” on page 131 


8.7.1 Understanding the Cascade Failover Prevention Quarantine 


The cascade failover prevention quarantine puts a resource in a comatose state rather than letting it 
load on (and potentially cause to fail) other cluster nodes. A resource can be quarantined if the 
systematic analysis of the logged node failures determines the following conditions to be true: 


¢ If the resource is likely responsible for several consecutive node failures, unrelated to 
interference from failures of other resources. 


The consecutive failures might have occurred on different nodes in the cluster. If the resource 
loads successfully on any node, the failure count for the resource starts over. 


+ If loading the resource will put the cluster in grave danger. 
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Novell Cluster Services does the following to determine if a resource should be put into quarantine: 


1. Traces the history of node failures for the suspected bad resource. This includes: 
+ What node the resource was running on or loading on 
If the node failed 


+ 


+ The state the resource was in when the node failed 


+ 


If there were other resources trying to load when the node failed 
2. Repeats the above process until one of the following happens: 
+ The end of the cluster log file is reached 
+ Enough consecutive node failures are found 
Found that the node did not fail 
¢ Found that the whole cluster was down 


+ 


+ The entries in the log file are more than 365 days old 


If the resource attempts to load on a node where it was previously loaded and there are additional 
nodes still available in the cluster, it will not be quarantined and will be allowed to load. Also, a 
resource is not quarantined when it is initially brought online. 


For a particular resource, there is no fixed number of node failures that triggers a quarantine. 
Generally, three consecutive node failures triggers a resource quarantine. However, the actual 
number of failures considered can vary based on other factors like how many nodes are in the cluster 
and what other resources are doing at the time of the node failures. For example, if no other 
resources are in a running or loading state when a resource loads but never reaches a running state, 
then two consecutive node failures may trigger resource quarantine. 


Factors that might contribute to a resource being quarantined include: 


+ A large number of consecutive node failures (generally, three or more) 
+ No other resources are causing node failures 


+ The resource never reaches a running state 
Factors that might help prevent a resource from being quarantined include: 


+ A small number of consecutive node failures (generally, one or two) 
+ The resource has failed on this node previously 

+ Other resources are causing node failures 

+ The resource reaches a running state 


+ There is one node left up and running in the cluster 
The resource quarantine is disabled if: 
e Cascade Failover Prevention is turned off. 


See “Releasing a Resource from Quarantine” on page 131. 
+ There is no shared storage (SAN) or SBD partition. 


+ There are enough nodes in the cluster to form a quorum. 
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8.7.2 Releasing a Resource from Quarantine 


While a resource is in quarantine, you can still manually take the resource from the comatose state to 
an offline state, and then bring it online or cluster migrate it to other cluster nodes. 


To get the resource out of quarantine so that is once again able to automatically fail over: 


1 Log in to the node as the root user. 


2 Disable Cascade Failover Prevention. See “Disabling Cascade Failover Prevention” on 
page 131. 


” 


3 Re-enable Cascade Failover Prevention. See “Manually Enabling Cascade Failover Prevention 
on page 132. 


8.7.3 Enabling or Disabling Cascade Failover Prevention 


The Cascade Failover Prevention function is enabled by default when you install Novell Cluster 
Services. You can control Cascade Failover Prevention by creating a configuration file in the /etc/ 
modprobe . d folder, and using it to disable and enable the ncs_cascade_ failover detection flag. 
Two detection modes are supported: 
+ A value of 0 disables the function. 
+ A value of 2 enables the function. This value is assumed of the configuration file does not exist, 
or if the flag line is not present in the file. The file does not exist by default. 


The setting in the file is specific to a node, and is set separately on each node. After you modify the 
setting on a node, you must manually unload and reload Novell Cluster Services software on the 
server to apply change. The setting persists through patches and upgrades. 

¢ “Disabling Cascade Failover Prevention” on page 131 


¢ “Manually Enabling Cascade Failover Prevention” on page 132 


Disabling Cascade Failover Prevention 


You might need to disable the Cascade Failover Prevention function for the following reasons: 


+ To get a resource out of quarantine and allow it to once again automatically fail over, you can 
temporarily disable the Cascade Failover Prevention function on the node where the resource 
was taken offline. 


+ To stop using the Cascade Failover Prevention function in the cluster, you can disable the 
function on every node in the cluster. 
To disable Cascade Failover Prevention: 


1 Log in to the node as the root user. 
2 Navigate to the /etc/modprobe .d folder. 


3 Ina text editor, create a configuration file (Such as novell-ncs.con£) under the /etc/ 
modprobe .d folder. 


If the file already exists, open it. 
4 Add the following content to the file. If the line already exists, change the flag value to 0. 


options crm ncs_ cascade failover _detection_flag=0 


The flag value 0 disables Cascade Failover Prevention for the node. 
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5 Save the file, then close the text editor. 
6 Open a terminal console, then restart Novell Cluster Services software to apply the modified 
Cascade Failover Prevention setting on this node: 


renovell-nes restart 


7 Repeat this procedure on other nodes where you want to disable Cascade Failover Prevention. 


8 (Optional) Re-enable Cascade Failover Prevention as described in “Manually Enabling Cascade 
Failover Prevention” on page 132. 


Manually Enabling Cascade Failover Prevention 


You might need to manually re-enable Cascade Failover Prevention: 


¢ If you disabled the function to release resources from the quarantine 


¢ If you disabled the function for other reasons 
To enable Cascade Failover Prevention: 


1 Log in to the node as the root user. 
2 Navigate to the /etc/modprobe .d folder. 
3 Use one of the following methods to enable Cascade Failover Prevention: 


+ Delete the file: Delete the /etc/modprobe.d/novell-ncs.conf file that you created in 
“Disabling Cascade Failover Prevention” on page 131. 


+ Change the value to 2: In a text editor, open the /etc/modprobe.d/novell-ncs.conf file 
that you created in “Disabling Cascade Failover Prevention” on page 131, change the flag 
value from 0 to 2, then save the file. 


options crm ncs_cascade failover detection_flag=2 


The flag value 2 enables Cascade Failover Prevention for the node. 


+ Delete the line: In a text editor, open the /etc/modprobe.d/novell-ncs.conf file that you 
created in “Disabling Cascade Failover Prevention” on page 131, remove the 
ncs_cascade_ failover _detection_flag line, then save the file 


4 Open a terminal console, then restart Novell Cluster Services software to apply the modified 
Cascade Failover Prevention setting on this node: 


renovell-nes restart 


5 Repeat this procedure on other nodes where you want to enable Cascade Failover Prevention. 


8.8 Configuring NCS to Monitor the eDirectory 
Daemon (ndsqd) 


Novell Cluster Services requires eDirectory to be running when you manage the cluster and 
resources. At other times, NCS uses a file cache of information retrieved from eDirectory to cover 
temporary eDirectory or LDAP outages. This allows normal cluster operations to be less dependent 
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8.8.1 


on eDirectory than some clustered services that require the eDirectory daemon (ndsqd) to be running 
in order to function properly. An eDirectory outage might not impact NCS, but it can render the 
services provided by cluster resources to be non-functional. 


Beginning in OES 11 SP2, NCS provides the ability to monitor the status of the eDirectory daemon 
(ndsd) at the NCS level. It is disabled by default. The monitoring can be set independently on each 
node. It runs whenever NCS is running on the node. The settings persist across system restarts, 
patches, or upgrades. 


IMPORTANT: If you enable NDSD monitoring at the NCS level, you should remove or comment out 
the eDirectory status checks in individual monitor scripts. 


¢ Section 8.8.1, “Understanding eDirectory Monitoring,” on page 133 

¢ Section 8.8.2, “Displaying the Current Settings for NDSD Monitoring,” on page 134 
¢ Section 8.8.3, “Configuring or Modifying NDSD Monitoring,” on page 134 

¢ Section 8.8.4, “Disabling NDSD Monitoring,” on page 135 


Understanding eDirectory Monitoring 


Novell Cluster Services can monitor the eDirectory daemon for nodes where eDirectory is installed. 
You might want to monitor the status of ndsd if you cluster services that depend on the eDirectory 
daemon running in order to function properly, such as for logins of CIFS, AFP, or NCP users. These 
service resources might run on only a subset of the nodes in the cluster or on all of the nodes. Each 
node’s monitoring is configured separately. 


Each monitoring iteration includes an interval of time to wait until NCS sends a request for status to 
ndsd, and a timeout period to listen for a response. You must specify the interval and timeout periods 
in seconds. The minimum interval is 16 seconds. The minimum timeout is 8 seconds. The following 
actions occur during the iteration: 

1. The iteration begins. 
. NCS waits for the specified interval. 
. The interval ends, and NCS sends a status query to ndsd. 
. The timeout period begins, and NCS listens for a response. 


a A WwW N 


. Three actions are possible: 


+ Ifthe ndsd status returns within the timeout period and it is good, the iteration ends and 
monitoring continues. 


¢ Ifthe ndsd status returns within the timeout period and it is not good, the specified remedy 
action is taken. 


+ Ifthe timeout period elapses without a response from ndsd, the specified remedy action is 
taken. 


6. The monitoring continues with a new iteration. 


If the ndsd status is bad or no status is returned within the timeout period, NCS can take one of three 
configurable remedy actions: an ndsd restart, a graceful node restart, or a hard node restart. 


+ restart-ndsd: Restarting the eDirectory daemon (ndsd) is the least intrusive action. However, it 
has the least chance of solving the problem. Even if the restart succeeds, the affected services 
might not be able to take advantage of the success. 
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+ reboot-node: A graceful node restart attempts to synchronize the file systems and terminate all 
running processes. This option might not resolve a service’s problem if a process is stuck, and it 
can delay a resource failing-over to a another node. 


¢ hard-reboot: A hard node restart has a better chance of forcing resources to promptly fail over 
to other nodes. However, it does not synchronize the file systems, and clients can lose data that 
has not been committed to disks. 


You use the /opt/novell/nes/install/ncs_install.py script to enable, disable, or modify 
monitoring of the eDirectory daemon for a node. Issue the command from a console prompt as the 
root user. 


/opt/novell/ncs/install/ncs_install.py 
-m <display|disable|restart-ndsd| reboot -node|hard-reboot | help> 
[-i <interval_value>] 
[-t <timeout_value>] ] 


For information about the command syntax and options, see Section A.8.2, “Monitoring NDSD,” on 
page 469. 


8.8.2 Displaying the Current Settings for NDSD Monitoring 


1 Open a terminal console, then enter as the root user: 
/opt/novell/ncs/install/ncs_install.py -m display 
Example 1: Display current settings for ndsd monitoring, and monitoring is enabled. 


# /opt/novell/ncs/install/ncs_install.py -m display 
NDSD monitoring is enabled. 
interval = 90 seconds, timeout = 20 seconds and remedy action is rebooting node hard. 


Example 2: Display current settings for ndsd monitoring, and monitoring is disabled. 


# /opt/novell/ncs/install/ncs_install.py -m display 
NDSD monitoring is not enabled. 


8.8.3 Configuring or Modifying NDSD Monitoring 


1 Open a terminal console, then enter as the root user: 


/opt/novell/ncs/install/ncs_install.py -m <hard-reboot |reboot-node|restart-ndsd> -i 
<interval_value> -t <timeout_value> 


Example 1: Enable ndsd monitoring with an interval of 60 seconds, timeout of 15 seconds, and 
remedy action of rebooting gracefully. 
# /opt/novell/ncs/install/ncs_install.py -m reboot-node -i 60 -t 15 


NDSD monitoring is enabled. 
interval = 60 seconds, timeout = 15 seconds and remedy action is rebooting node. 


Example 2: Change the remedy action to restarting ndsd. 


# /opt/novell/ncs/install/ncs_install.py -m restart-ndsd -i 60 -t 15 


NDSD monitoring is enabled. 
interval = 60 seconds, timeout = 15 seconds and remedy action is restarting ndsd. 
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8.8.4 


8.9 


Disabling NDSD Monitoring 


Monitoring of the eDirectory daemon is disabled by default. If it is enabled on a node, you can use the 
following procedure to disable it. 


1 Open a terminal console, then enter as the root user: 
/opt/novell/nes/install/ncs_install.py -m disable 
Example: Disable ndsd monitoring. 


# /opt/novell/ncs/install/ncs_install.py -m disable 
ndsd monitoring is not enabled (3). 


Configuring the Cluster Node Reboot Behavior 


If LAN connectivity is lost between a cluster node and the other nodes in the cluster, it is possible that 
the lost node will be automatically shut down by the other cluster nodes. This is normal cluster 
operating behavior, and it prevents the lost node from trying to load cluster resources because it 
cannot detect the other cluster nodes. The Novell Cluster Services reboot behavior conforms to the 
kernel panic setting for the Linux operating system. By default the kernel panic setting is set for no 
reboot after a node shutdown. On certain occasions, you might want to prevent a downed cluster 
node from rebooting so you can troubleshoot problems. 


To control the cluster node reboot behavior, you can use the directive kernel . panic in the Linux / 
etc/sysctl.conf file to prevent a reboot, or to allow an automatic reboot and to specify the number 
of seconds to delay the reboot. Set the kernel . panic value to 0 for no reboot after a node shutdown. 
Set the kernel. panic value to a positive integer value to indicate that the server should be rebooted 
after waiting the specified number of seconds. For information about using the Linux sysct1, see the 
Linux man pages on sysct1(8) and sysctl.conf (5). 

1 As the root user, open the /etc/sysctl.conf file in a text editor. 


2 If the kernel .panic token is not present, add it. 
kernel.panic = 0 


3 Set the kernel .panic value to 0 or to a positive integer value, depending on the desired 
behavior. 


+ No Reboot: To prevent an automatic cluster reboot after a node shutdown, set the 
kernel .panic token to value to 0. This allows the administrator to determine what caused 
the kernel panic condition before manually rebooting the server. This is the recommended 
setting. 


kernel.panic = 0 


+ Reboot: To allow a cluster node to reboot automatically after a node shutdown, set the 
kernel .panic token to a positive integer value that represents the seconds to delay the 
reboot. 


kernel.panic = <seconds> 


For example, to wait 1 minute (60 seconds) before rebooting the server, specify the 
following: 


kernel.panic = 60 


4 Save your changes. 
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8.10 


8.10.1 


Configuring STONITH 


The STONITH (shoot-the-other-node-in-the-head) capability allows Novell Cluster Services to 
remotely kill a suspect node by using remote power control instead of using a poison pill. STONITH 
does not require any action from the node being killed, unlike poison pills, which allows it to kill non- 
responsive nodes. 


Using STONITH requires that you have server power management technology for all nodes in the 
cluster. STONITH supports remote accessible cards integrated in a cluster node’s hardware, such as 
Integrated Lights Out (iLO) from Hewlett-Packard (HP) and Dell Remote Access Card (DRAC) from 
Dell, and stand-alone web-based power switches. Refer to the vendor documentation to determine 
how your power management system works. 


To use STONITH in Novell Cluster Services, you must create an executable /opt /novell/ncs/bin/ 
NCS_STONITH SCRIPT script file to authenticate to your power controller and turn off the power, cycle 
the power, or reset the power for the node. The script should take the node number as the only 
parameter. Node numbers are assigned as 0 to 31 for nodes 1 to 32. These are the same node 
numbers that appear in the /var/opt /novell/ncs/gipc.conf file. Creating the script file 
automatically enables STONITH for the node; you do not need to restart anything. 


IMPORTANT: STONITH does not replace poison pills in Novell Cluster Services. Novell Cluster 
Services issues poison pills before running the STONITH script. 


Use the following sample scripts as a guide for how to create a script that works with your power 
management technology: 

¢ Section 8.10.1, “Sample Script for HP iLO,” on page 136 

è Section 8.10.2, “Sample Script for Web-Based Power Switches,” on page 137 


Sample Script for HP iLO 


This section provides a sample script for HP iLO power management cards. The sample code 
assumes the following setup for the cluster and iLO cards: 


+ The iLO card on each node has been pre-configured to trust any instructions sent from each of 
the nodes in the same cluster. 


+ Each cluster node’s iLO card is assigned a sequential static IP address, beginning with 
192.168.188.201 on node 0, 192.168.188.202 on node 2, and so on up to 192.168.188.232 on 
node 32. 


If you alternatively use DNS names in your script, the translation must be performed by the 
script. 


+ The iLO card’s command to reset power is power reset. 


Refer to the HP documentation to determine the commands available for your iLO cards. 


For each node in the cluster, create the executable /opt /novell/ncs/bin/NCS_STONITH SCRIPT 
file and add the script below. The presence of the file automatically enables STONITH for the cluster. 
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8.10.2 


IMPORTANT: Ensure that you replace the sample information with the settings for your system. 


#! /bin/bash 


if [ -n "$1" ]; then 
echo "Recycling power of node number $1... " 
iloIP=$ (printf "192.168.188.2%02d" $(($1+1))) 
nodeIP="grep "“nodeid .* ${1}\>" /var/opt/novell/ncs/gipc.conf | cut -d' ' -f2> 
while [ 1 ]; do 
ssh ${iloIP} power reset 
echo 
sleep 2 


if ! ping -c 1 ${nodeIP} | grep "1 received" &> /dev/null 
then 
break 
fi 
sleep 5 
done 
fi 


Sample Script for Web-Based Power Switches 


This section provides a sample script for web-based power switches. The sample code assumes the 
following setup for the cluster and power switch: 
+ Each cluster node is assigned a sequential static IP address, beginning with 10.10.189.100. 


¢ Each cluster node is plugged in to a sequential outlet in the power switch, beginning with node O 
in the first outlet. 


+ The authentication information for the power switch management interface is: 
+ User name: admin 
¢ Password: novell 
¢ IP address: 10.10.189.149 

+ The power management switch’s command to cycle power is CCL. 


Each vendor can have different command options available. Refer to your vendor documentation 
to determine the commands used by your power switch. 


For each node in the cluster, create the executable /opt /novell/ncs/bin/NCS_STONITH SCRIPT 
file and add the script below. The presence of the file automatically enables STONITH for the cluster. 


IMPORTANT: Ensure that you replace the sample information with the settings for your system. 


#! /bin/bash 


until [ -2 "$1" ] 
do 
nodeNum="expr $1 + 1^ 
echo "Recycling power of node number $nodeNum ... " 
while [ 1 ]; do 
curl -u admin:novell http://10.10.189.149/outlet?${nodeNum}=CCL 


echo 
sleep 2 
if ! ping -c 1 10.10.189.10${nodeNum} | grep "1 received" &> /dev/null 
then 
break 
Er 
sleep 5 
done 
shift 


done 
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8.11 Viewing or Modifying the NCS Proxy User 
Assignment in the NCS Management Group 


When you configure a cluster, the NCS Management Group (<cluster_name>_MGT_GRP) is created 
in the Cluster object container. The group contains the user that you specify for the NCS Proxy User 
on the Proxy User Configuration page as described in Step 3 in Section 5.5.5, “Configuring a New 
Cluster,” on page 83: 


+ OES Common Proxy User 
+ LDAP Admin User 
+ Another administrator user 


The specified user is automatically added as a member of the group. If you specify the OES Common 
Proxy User, each nodes’ OES Common Proxy User is added to the group. 


If the OES Common Proxy User is later disabled in eDirectory for a node, the LDAP Admin user 
automatically replaces that user in the group. 


You can view a list of members in the <cluster_name>_MGT_GRP in iManager. Select the Directory 
Administration > Modify Object function in iManager, then search for the group. Figure 8-1 shows the 
OES Common Proxy users for each node in a cluster named clus1. 


Figure 8-1 Viewing Members of the NCS Management Group (<cluster_name>_MGT_GRP) 
Falk 

Modify Object: agclus!_MGT_GRP nes. novell 

General \ Security | Dynamic FSC 0 -i h} Nested \ LinuxProfile \ iPrint Client Management| 


Member: 


| OESCommonProxy_avalon.novell i) 
OESCommonProxy_camelot.novell 
OESCommonProxy_excalibur.novell 
OESCommonProxy_cornwall.novell 


Count: 4 


IMPORTANT: Do not attempt use the Modify Object page to add or remove members of the 
<cluster_name>_MGT_GRP group. You must use the /opt/novell/ncs/install/nces_install.py 
script to add or remove members. 


You can modify the users assigned as the NCS Proxy User by using the /opt /novell/ncs/ 
install/nes_install.py script. You are prompted for the distinguished user name and password 
for the user that you want to assign. The specified user is added to the group, and the old user is 
removed from the group. 


1 Log in to the server as the root user, then open a terminal console. 


2 At the command prompt, enter 


/opt/novell/ncs/install/ncs_install.py -1 -u 
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In addition, you can change other configurations by providing a configuration file (Such as / 
root /ncs.conf) to the above command. You must create the file and its content before issuing 
the command. For example: 


/opt/novell/ncs/install/ncs_install.py -1 -f /root/ncs.conf -u 


3 When you are prompted, provide the comma-delimited distinguished name of the user to be 
assigned to the NCS_ Management group, such as 


cn=ncs_admin,o=novell 


4 When you are prompted, provide the password for the user you specified. 


8.12 Viewing or Modifying the Cluster Master IP 
Address or Port 


The cluster IP address is assigned to the Master IP Address Resource of the cluster when you 
configure the first node in a Novell Cluster Services cluster. The cluster IP address is separate from 
the server IP address and is required for some external programs to get cluster status alerts. The IP 
address is bound to the master node and remains with the master node regardless of which server is 
the master node. 


The cluster IP address normally does not need to be changed, but it can be changed for any reason. 
For example: 


+ A duplicate IP address conflicts with the master IP address. 
+ You want to move the cluster to a different IP subnet. 
+ You want to reallocate IP addresses in the same subnet. 


You normally connect to the master IP address to manage the cluster. If the master IP address has 
connection problems, the Clusters > My Clusters page in iManager allows you to use the server IP 
address of a node (preferably the master node) to manage the cluster and fix the problem. For 
example, the following connection problems can prevent you from connecting to the master IP 
address to manage the cluster: 


+ Another device on the network is using the master IP address, and the Master IP Resource 
cannot come online. 


+ There are underlying communications errors for the SFCB protocol, and you get an error in 
iManager when you try to connect to the Master IP Resource of the cluster. For example errors, 
see “iManager errors while trying to manage Cluster, Storage, User Quotas, CIFS or AFP” 
(Technical Information Document 7010295) (http:/Awww.novell.com/support/kb/ 
doc.php?id=7010295). 


Connecting to a node’s IP address is a temporary measure to allow you to resolve the master IP 
address problem. It is not intended as an alternative way to manage the cluster. The option is not 
available from the My Resources page. 


The default cluster port number is 7023, and is automatically assigned when the cluster is created. 
The cluster port number does not need to be changed unless a conflict is created by another 
resource using the same port number. If there is a port number conflict, change the Port number to 
any other value that doesn't cause a conflict. 
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IMPORTANT: After you change the cluster IP address or port number, you must restart Cluster 
Services, exit iManager, and relaunch iManager before iManager can manage the cluster with the 
new IP address. 


1 In iManager, select Clusters > My Clusters. 
2 In your personalized My Clusters list, view the status of the cluster you want to manage. 


If the cluster does not appear in your list, add the cluster to your list as described in Section 8.2, 
“Setting Up a Personalized List of Clusters to Manage,” on page 117. 


3 If the master IP address does not respond to the status query, an error message prompts you to 
temporarily manage the server with the server IP address of the master node (preferred) or of 
any active node. 


The message appears each time that you revisit the My Clusters page until you resolve the IP 
address conflict on the network or by modifying the cluster’s master IP address. 


Failed to retrieve status information 
about cluster clusl via master IP 
address 10,10.10.242., 


Do you want to select a cluster node 
(preferably the master node) to manage the 
cluster? 


Please note that the selection will be 
temporary. You need to select again 
whenever "My Clusters" page loads. 


Please use this opportunity to fix the master 
IP address. 


3a Read the error message, then do one of the following: 


+ Use a server node (preferably the master): Click Yes to agree to use the server IP 
address of a node to temporarily manage the cluster. Continue to Step 3b. 
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+ View error details: Click No to view the Cluster Communication Error details. It 
provides some tips for diagnosing the root cause of the IP address conflict. Click OK to 
dismiss the message. Try to resolve the conflict on the network, then select Clusters > 
My Clusters (Step 1) to see if the connection issue is resolved. 


& Error: Cluster Communication Error 


An error occurred while communicating between iManager and the CIMOM broker running on the cluster master node. 
Click the "More Info” button below for the full stack trace. 


Summary: 
Error: 316009-12 (BROKER_ERROR_NO_ROUTE_TO_HOST) - No route to host (10.10,10.242) 


Diagnosis: 


This error signals that a problem occurred while attempting to make a socket connection to the cluster at IP address: 
10.10.10.242 and port: 5989. Typically this error occurs because the IP address for the cluster cannot be reached 
from the iManager server possibly because of an intervening firewall, or if an intermediate router is down. It can also 

occur when the master IP address resource is down, or there are no nodes in the cluster. 


Suggestions: 
The following suggestions may help to further narrow dowm or resolve the problem: 


+ Verify the cluster IP address is correct: 10.10.10.242. First, check "NCS:Network Address” attribute and make 
sure the hex translates into the IP Address for the Master IP Resource. Next, check the "Network Address” 
attribute which has the TCP and UDP port 524 addresses for the Master IP Resource address as well. These 
addresses should match the "NCS:Network" address. If these addresses differ, manually change them to match. 
This could be the case if the IP address was ever changed on the cluster. 


Verify the ability to connect to the cluster master node by pinging the cluster IP address from a terminal on 
the iManager server. 

+ Confirm that the IP address for the "Master IP Address” Resource is bound to the master nade. On the console, 
type: “ip addr show | grep secondary” and you should see it bound. The Master IP address needs to be the same 


in the cluster load and unload scripts, and in the attributes of the cluster object in "NCS:Network Address” and 
“Network Address” with UDP and TCP. 


+ If you are still getting this error, click the “More Info” button below, and copy and paste the contents in an 
email to Novell Technical Support. 


OK | _ More Info 


3b Browse to choose the node (preferably the master node) to use to temporarily manage the 
cluster, then click OK. 


Contents: sta-cictts carta setecten range) 


c Meta Say os) 
Selected Objects: 1 «ich objects usech 
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4 After the clusters connection is made, select the check box next to the cluster, then click Action 
> Edit Properties to open the Cluster Properties dialog box. 


My Clusters 2] 


he list below prowdes 3 convenient way to weep tach of Clusters you trequentiy manage. Click on the add 
humon to browse fai chesters in the thee, and select tham to be added to the list 


Add Remove ‘chen + Retresh 


J Status Nae Run Report Hose IP Adhess Nodes Epoch BCC 
7 @ Fi Edt rrepenies (llon 10.10.10,242 in o 
Peper 


5 Inthe Cluster Properties dialog box, click the Policies tab. 


Normally, the cluster name (such as clus1.ncs.exampl1e) is displayed if you access the cluster 
properties via the Master_IP_Resource. The server name (such as avalon.example, shown 
below) is displayed if you access the properties via a server node in Step 3. 


¥ avalon.example Lej 
Priorities \ Protocols \ RME Groups \ Business Continuity 


iev ange Cluster IP address, port numbers, quorum triggers, and cluster email notification. Changing the IP address requires 
a cluster restart before iManager can continue to manage the cluster. 


Cluster Information Notification 

IP Adcress: 10.10,10.242 MI Enable Cluster Notification Events 

Port 7023 EMail Addresses 
mysdmin@example.com y 

Quorum Triggers 

Timeout (60 | [Seconds v] (© Receive Onty Critical Events 

Number of Nodes: | 1 | © Verbose Messages 


[C] xe Messages 


— OK | _ Cancel | Apply | 
6 Under Cluster Information, specify the new value for the IP address or port. 


Cluster Information 


IP Address: 10.10.10.243 


Port: 7023 


7 Click OK to save and apply your changes. Wait for the success notification before continuing. 


A cluster restart is required before iManager can continue to manage the cluster with its new 
master IP address. 


Success: Chater Properties Updated Successfully 


The changes have been successfully sent to the cluster master node. 


8 Exit iManager and close the web browser. 
9 Restart Cluster Services. Open a terminal console as the root user, then enter 


renovell-nes restart 


142 OES 11 SP3: Novell Cluster Services for Linux Administration Guide 


avalon:-/Desktop # rcnovell-ncs restart 
Stopping Novell Cluster Services 


Leaving... 
No Longer a member of cluster 
La- + 
# 
# Please wait for the Novell Cluster Services KOs to unload 
# | 
#------------- 2-2 2-2 2 2 ee ee ee eee eee eee eeee + 
Novell Cluster Services Unloaded 
done 
Starting Novell Cluster Services 
Mounting adminfs at /admin ... already mounted done 


done 
avalon:~/Desktop # Joining... 
Now a member of 
Cluster clusl 


This node avalon [ epoch O master node avalon ] 
Cluster nodes [ avalon ] 


10 Launch a web browser and log in to iManager to continue managing the cluster. 


8.13 Moving a Cluster, or Changing the Node IP 
Addresses, LDAP Servers, or Administrator 
Credentials for a Cluster 


Use the instructions in this section to change the IP address of the cluster, information about the 
LDAP servers that the cluster uses, or the credentials used to administer the cluster. 


¢ Section 8.13.1, “Changing the Administrator Credentials or LDAP Server IP Addresses for a 
Cluster,” on page 143 


¢ Section 8.13.2, “Moving a Cluster or Changing IP Addresses of Cluster Nodes and Resources,” 
on page 145 


8.13.1 Changing the Administrator Credentials or LDAP Server IP 
Addresses for a Cluster 
You can modify the administrator credentials or LDAP server settings that you assigned when you 


created the cluster. If eDirectory is not installed on a node, it looks to the LDAP server list for 
information about which LDAP server to use. 


You must modify this cluster information in the following cases: 


+ Changing the Administrator user name and password for the cluster 

+ Changing the password for the existing Administrator user name 

¢ Changing the IP address information about the existing LDAP servers 
¢ Assigning a different LDAP server for the cluster to use 


+ Changing the order of the servers in the LDAP server list 
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As a best practice, you should list the LDAP servers in the following order: 
¢ Local to the cluster 
+ Closest physical read/write replica 
+ Adding LDAP servers to the list of ones that the cluster can use. 


You can modify these settings at any time. Novell Cluster Services can be running or not running. 


To modify the LDAP server IP address or administrator credentials in the Novell Cluster Services 
configuration settings: 


1 Ensure that the administrator user name that you plan to use meets the requirements specified 
in Section 4.1, “Cluster Administration Requirements,” on page 47. 


2 Ensure that the LDAP servers that you want to specify for the cluster are in the same eDirectory 
tree, and that the IP addresses meet the requirements in Section 4.2, “IP Address 
Requirements,” on page 50. 


3 Log in as the root user to the master node of the cluster. 


4 In a text editor, create a text file, specify the configuration information for the Novell Cluster 
Services cluster in it, then save the file. 


Two examples are shown below of the content of the file with sample values. The directives are 
self-explanatory. 


IMPORTANT: Ensure that you change the values inside the quotation marks to the actual 
settings for your cluster. 


The following lines are the content of a sample configuration file for a Novell Cluster Services 
cluster when you have a single LDAP server. 


CONFIG _NCS_ CLUSTER _DN="cn=svrl_oes2_cluster.o=context" 
CONFIG NCS LDAP TP="10.1.1.102" 

CONFIG NCS LDAP PORT="636" 

CONFIG NCS ADMIN DN="cn=admin.o=context" 

CONFIG NCS ADMIN PASSWORD="password" 


If you have multiple LDAP servers, the syntax is slightly different. The following lines are the 
content of a sample configuration file for a Novell Cluster Services cluster when you have 
multiple LDAP servers. 


CONFIG NCS _CLUSTER_DN="cn=svrl_oes2_cluster.o=context" 

CONFIG NCS_LDAP INFO="ldaps://10.1.1.102:636,ldaps://10.1.1.101:636" 
CONFIG_NCS ADMIN DN="cn=admin.o=context" 

CONFIG NCS ADMIN PASSWORD="password" 


5 As the root user, enter the following command at a command prompt: 
/opt/novell/ncs/install/ncs_ install.py -l -f configuration filename 


Replace configuration_filename with the actual name of the file you created. 
6 Delete the configuration file that you created. 


7 For each of the other nodes in the cluster, log in as the root user for the node, then repeat 
Step 4 to Step 6. 


Modifying the information on each node allows iManager to manage the cluster after a different 
node becomes the master. This step is necessary because credentials are stored on CASA, and 
CASA does not synchronize across cluster nodes. 
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8.13.2 


8 Push this update to all nodes on the cluster by entering the following as the root user on one of 
the cluster nodes: 


cluster exec "/opt/novell/ncs/bin/nes-configd.py -init" 


Moving a Cluster or Changing IP Addresses of Cluster 
Nodes and Resources 


If you move a cluster to a different subnet, you must change the IP addresses of the cluster nodes 
and the cluster resources, information about the LDAP servers used by the cluster, and possibly the 
administrator credentials for the cluster. 


When you move the cluster to a new IP subnet, you must replace the existing unique static IP 
addresses with ones that are valid in that subnet. You can make the IP address changes in the old 
location or the new location. If you start the servers in the different IP subnet with the old IP 
addresses, the cluster does not come up until you make the changes described in this section. 


To modify the IP addresses of servers being used in a Novell Cluster Services cluster, perform the 
following tasks in the order given: 

¢ “Prerequisites” on page 145 

+ “Changing the IP Addresses of Cluster Resources” on page 145 

+ “Changing the IP Addresses of Servers in a Cluster” on page 147 

+ “Changing the IP Address of the Master IP Resource” on page 147 


e “Modifying the Cluster Configuration Information” on page 148 


Prerequisites 


Before you begin, ensure that the IP addresses that you plan to use meet the requirements specified 
in Section 4.2, “IP Address Requirements,” on page 50. Ensure that the administrator user name that 
you will use in the new location has sufficient rights as described in Section 4.1.3, “Cluster 
Administrator or Administrator-Equivalent User,” on page 50. 


Changing the IP Addresses of Cluster Resources 


Before you modify the server IP address for a server in a cluster, you must change the IP addresses 
of all of the cluster resources that run on it: 

1 In iManager, select Clusters > My Clusters. 

2 Select the cluster that you want to manage. 


If the cluster does not appear in your list, add the cluster to your list as described in Section 8.2, 
“Setting Up a Personalized List of Clusters to Manage,” on page 117. 


3 Offline the cluster resources whose IP addresses are changing. On the Cluster Manager page, 
select the check boxes next to the cluster resources, then click Offline. 


4 For each NSS pool cluster resource, modify the IP address on the resource’s Protocols page. 


4a On the Cluster Manager or Cluster Options page, click the pool cluster resource to open its 
Properties page. 


4b Click the Protocols tab. 
4c Modify the IP address for the NSS pool cluster resource. 
4d Click OK to save the changes. 
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This changes the IP address for the NcS:NCP Server object for the resource, and updates 
the instances of the IP address in the resource’s load, unload, and monitor script. 


Do not online the resource at this time. 


5 For each non-NSS cluster resource, modify the IP address information for the RESOURCE_IP 
variable as needed in the resource’s load, unload, and monitor scripts. 


5a 


5b 
5c 


5d 
5e 
5f 


On the Cluster Manager page or Cluster Options page, click the non-NSS cluster resource 
to open its Properties page. 


Click the Scripts tab, then click the Load Script link. 
Edit the script by replacing the RESOURCE_IP variable’s value with the new IP address. 


You might also need to edit the values used in the command lines if you did not use the 
variable there. 


IMPORTANT: Do not comment out commands that are automatically generated for 
parameters that define the cluster resource, such as the mount point, IP address, volume 
group name, file system type, and mount device. 


Click Apply to save the changed script. 
Make similar changes to the non-NSS resource’s Unload Script and Monitor Script. 
Repeat this process for each non-NSS cluster resource. 


Do not online the resources at this time. 


6 For each Linux cluster resource that has an NCP virtual server object, delete and re-create the 
NCS:NCP Server Object. 


6a 


6b 


In iManager, select the Directory Administration > Delete Object, select the NCS:NCP 
Server object for the Linux resource, then click OK. 


Re-create the NCS:NCP Server object with the new IP address: 
6b1 On the master cluster node, open a terminal console, then log in as the root user. 
6b2 In the console, use the cd command to go to the /opt /novell/ncs/bin directory. 
6b3 At the terminal console prompt, enter 
./nes_nepserv.py -c lv_volumename -i resource ip address 
Replace the /v_volumename and resource_ip_address with the information for your 
particular solution. 


Do not use periods in cluster resource names. Novell clients interpret periods as 
delimiters. If you use a space in a cluster resource name, that space is converted to an 
underscore. 


For example, to create the NCS:NCP Server object for the 1v44 cluster resource where 
the IP address is 10.10.10.44 and the cluster context is 
ou=clusters,ou=city,o=mycompany, enter 


./ncs_ncpserv.py -c lv44 -i 10.10.10.44 
The confirmation message is displayed: 


NCP Server 'cn=clusterl_1lv44_server,ou=clusters,ou=city,o=mycompany' 
created. 


7 Stop Novell Cluster Services for every node in the cluster by entering the following at the 
command prompt as the root user: 


146 OES 11 SP3: Novell Cluster Services for Linux Administration Guide 


renovell-necs stop 


8 Continue with “Changing the IP Addresses of Servers in a Cluster” on page 147. 


Changing the IP Addresses of Servers in a Cluster 


After preparing the cluster resources for the IP address change and stopping Novell Cluster Services 
(see “Changing the IP Addresses of Cluster Resources” on page 145), you are ready to change the 
IP addresses of the servers in the cluster. 


1 For each server in the cluster, change the server's IP address by following the instructions 
“Changing an OES 11 SP2 Server’s IP Address” in the OES 11 SP3: Planning and 
Implementation Guide. 


2 The server IP address changes are not complete until you make those changes known to Novell 
Cluster Services and eDirectory. Continue with “Changing the IP Address of the Master IP 
Resource” on page 147. 


Changing the IP Address of the Master IP Resource 


1 In iManager, click Directory Administration, then click Modify Object. 


2 Browse to locate and select the Master IP Address Resource object of the cluster you want to 
manage. 


Modify Object: gMaster_!P_Address_Resource cl242.ncs.novell 


| 


Valued Attributes Unvalued Attributes 
CN ~ ACL 
creatorsName Audit: File Link 
GUID Certificate Validity lmerval 
madifersName Cross Certiticate Pair 
NCS.CRM Failback Mode DirXML-Aasociations 
NCS CRM Failover Mode Equivalent To Me 
NCS.CRM ignore Quorum Last Reterenced Time 
NCS CRM Load Scrigt << maswAsthorized Range 
NCS.CRM Load Timeout maswDetaultRange 
NCS CRM Monitor Failure Period m maswProposedLa bei 
NCSCRM Monitor Frequency NCS CRM Montor Acton 
NCS.CRM Monitor Max Failures NCS Load Factor 
NCS CRM Monitor Script a Oher GUID 
NCS.CRM Monitor Timeout rbisAssigned Roles 
NCS CRM Preferred Nodes thsAssignedRoles2 
NCS CRM Unload Script <2 rhsOwnedCollections 
NCS.CRM Unload Timeout thsOwnedCollections2 
NCS Revision Unknown Auxiliary Class 
Objet Class Unknown Base Class 
Revision v 
Edit.. Delete 


OK} _ _Cancet__| __ Apply |__ Aefresh | 
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3 Inthe Valued Attributes list, select the attribute NCS:CRM Load Script, click Edit, modify the IP 
address in the script, then click OK. 


Edit Attribute 


NCS:CRM Load Script 

#'/bin/bash 
/opt/novell/ncs/lib/necsfuncse 

ignore_error 

add _ secondary _ipaddress 


10.10.10.242 -np 
exit 0 


— œ |___C | 


4 Inthe Valued Attributes list, select the attribute NCS:CRM Unload Script, click Edit, modify the 
IP address in the script, then click OK. 


5 Inthe Valued Attributes list, select the attribute NCS:CRM Monitor Script, click Edit, modify the 
IP address in the script, then click OK. 


6 At the bottom of the page, click OK to save the changes. 
7 Continue with “Modifying the Cluster Configuration Information” on page 148. 


Modifying the Cluster Configuration Information 


Before restarting Novell Cluster Services, you must update the cluster configuration information in 
Novell Cluster Services and eDirectory with the new IP addresses. You might also need to update the 
IP address information for the LDAP server and administrator credentials that the cluster uses in the 
new subnet. 


1 If the cluster is using a different LDAP server or administrator in the new IP subnet, change the 
LDAP server IP address and administrator credentials for the cluster in the Novell Cluster 
Services configuration settings. 


Follow the procedure in Section 8.13.1, “Changing the Administrator Credentials or LDAP Server 
IP Addresses for a Cluster,” on page 143. 


2 For each node in the cluster, including that of the master IP address resource, modify the NCS: 
Network Address attribute of its Cluster Node object. 


2a In iManager, select Directory Administration > Modify Object. 


2b Browse to locate and select the Cluster Node object of the cluster node you want to 
manage. 


2c In the Valued Attributes list, select the attribute NCS: Network Address, click Edit, modify 
the IP address, then click OK. 
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Edit Attribute 


NCS ‘Network Address 


IP: 10.10.10.242 


OK | Cancel 


l 


KI 


2d Repeat this process for each node in the cluster and the master IP resource. 


3 For the cluster container of the cluster you want to manage, modify the NCS: Network Address 
and Network Address attributes of its Cluster object to specify the new IP address information. 
Both TCP and UDP addresses need to be replaced. 


3a In iManager, select Directory Administration > Modify Object. 
3b Browse to locate and select the Cluster object of the cluster you want to manage. 


Modify Object: e242 ncsnovell 


a 


Valued Attributes 


CN 

CreatorsName 

GuID 

mod ifiersName 

NCS CRM Quorum 

NCS CRM Quorum Timeout 
NCS CRM Resource Priority 
NCS Email! Addresses 

NCS Email Filter 

NCS GIPC Heartbeat 

NCS GIPC Master Watchdog 
NCS GIPC Max Retrarsmis 
NCS GIPC Slave Wakhdog 
NCS GIPC Tolerance 


Unvalued Attributes 


ACL 
Audit File Link 
Certificate Validity interval 
Cross Certificate Pair 
OirXM | -Aasocomtions 
Equrealent To Me 
Last Referenced Time 
masvAuthorizedRange 
masyDetautRange 

= masy Proposed Label 
NCSCRM HMO Seting 
NCSCRM Load Seript 
NCS.CRM Load Timeout 
NCS-CRM Unload Script 


NCS Network Address Eem] NCSCRM Uniced Timeout 

NCS Port Number NCS:GIPC Contig = 

NCS Revision NCS Node tsollation Script 

NCS Shared Disk Flag M] Other GUID 

Network Address < — rbsAsug nedRoles = 

Obed Cus v rtnAsugnedRolew? v 
— t. | ——Detete_| 


— OK __| __Cancet__| __ Apply _ Refresh | 


3c Inthe Valued Attributes list, select the attribute NCS: Network Address (the attribute for the 
TCP address), click Edit, modify the IP address, then click OK. 


3d Inthe Valued Attributes list, select the attribute Network Address (the attribute for the UDP 
address), click Edit, modify the IP address, then click OK. 


4 Ensure that the LDAP server is running before restarting Novell Cluster Services. 


IMPORTANT: Novell Cluster Services requires LDAP. 


5 Ensure that NSS is running if there are NSS cluster resources that you will bring online. 


6 Start Novell Cluster Services by entering the following command at a command prompt as the 
root user: 


renovell-ncs start 

7 Online the cluster resources: 
7a In iManager, select Clusters > My Clusters. 
7b Select the cluster that you want to manage. 


7c On the Cluster Manager page, select the check boxes next to the cluster resources, then 
click Online. 
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8.14 


150 


What’s Next 


For information about managing the cluster, see Chapter 9, “ Managing Clusters,” on page 151. 


After installing and configuring the cluster, you are ready to configure cluster resources for it. See the 
following: 


+ 


+ 


+ 


Chapter 10, “Configuring and Managing Cluster Resources,” on page 193 
Chapter 11, “Quick Reference for Clustering Services and Data,” on page 233 


Chapter 12, “Configuring and Managing Cluster Resources for Shared NSS Pools and 
Volumes,” on page 237 


Chapter 13, “Configuring and Managing Cluster Resources for Shared LVM Volume Groups,” on 
page 327 


Chapter 14, “Upgrading and Managing Cluster Resources for Linux POSIX Volumes with CSM 
Containers,” on page 399 
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Q Managing Clusters 


After you have installed, set up, and configured Novell Cluster Services on Novell Open Enterprise 
(OES) 11 SP3 servers and configured cluster resources, use the information in this section to help 
you effectively manage your cluster. This section provides instructions for migrating resources, 
identifying cluster and resource states, and customizing cluster management. 


IMPORTANT: For information about using console commands to manage a cluster, see Appendix A, 
“Console Commands for Novell Cluster Services,” on page 449. 


¢ Section 9.1, “Starting and Stopping Novell Cluster Services,” on page 152 

¢ Section 9.2, “Taking the Cluster Down,” on page 154 

¢ Section 9.3, “Selecting a Cluster to Manage,” on page 154 

¢ Section 9.4, “Monitoring Cluster and Resource States,” on page 157 

¢ Section 9.5, “Responding to a Start, Failover, or Failback Alert,” on page 159 

¢ Section 9.6, “Viewing the Cluster Event Log in iManager,” on page 161 

¢ Section 9.7, “Viewing the Cluster Event Log at the Command Line,” on page 163 


¢ Section 9.8, “Viewing Summaries of Failed or Incomplete Events from the *.out Log Files,” on 
page 164 


¢ Section 9.9, “Generating a Cluster Configuration Report,” on page 165 
¢ Section 9.10, “Repairing a Cluster,” on page 166 


¢ Section 9.11, “Onlining and Offlining (Loading and Unloading) Cluster Resources from a Cluster 
Node,” on page 167 


¢ Section 9.12, “Cluster Migrating Resources to Different Nodes,” on page 168 
¢ Section 9.13, “Removing (Leaving) a Node from the Cluster,” on page 170 
¢ Section 9.14, “Joining a Node to the Cluster (Rejoining a Cluster),” on page 171 


¢ Section 9.15, “Shutting Down Novell Cluster Services When Servicing Shared Storage,” on 
page 171 


¢ Section 9.16, “Enabling or Disabling Cluster Maintenance Mode,” on page 172 
¢ Section 9.17, “Viewing the Cluster Node Properties,” on page 172 
¢ Section 9.18, “Creating or Deleting Cluster SBD Partitions,” on page 173 


¢ Section 9.19, “Customizing Cluster Services Management,” on page 190 
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9.1 


9.1.1 


9.1.2 


Starting and Stopping Novell Cluster Services 


Novell Cluster Services automatically starts after it is installed. It also automatically starts when you 
reboot your OES server. 


If you need to restart adminfs, you must stop Novell Cluster Services before you stop adminfs, or 
you can reboot the server. 


IMPORTANT: If you are using iSCSI for shared disk system access, ensure that you have configured 
iSCSI initiators and targets to start prior to starting Novell Cluster Services. You can do this by 
entering the following at the Linux terminal console: 


chkconfig open-iscsi on 


Starting Novell Cluster Services 


If you stop Novell Cluster Services, you can restart it by doing the following: 


1 Open a terminal console, then log in as the root user. 
2 Use one of the following methods to start Novell Cluster Services: 


+ At the command prompt, go to the /etc/init.d directory and enter 
./novell-nes start 
+ At the command prompt, enter 
renovell-necs start 
3 Verify the cluster status: 


cluster status 


Stopping Novell Cluster Services 


Novell Cluster Services is a kernel-space application. As with any kernel-space application, unloading 
it is a best effort and is not guaranteed to stop the modules. If Novell Cluster Services is busy 
providing services from the kernel when you attempt to stop it, the process might not stop, and a 
reboot might be required. 


1 Open a terminal console, then log in as the root user. 
2 Check whether the node is active in the cluster. Enter 


cluster view 


If the node is in the cluster (and not still in a process of joining the cluster), it is relatively safe to 
attempt to stop it. 


3 Use one of the following methods to stop Novell Cluster Services: 
¢ Goto the /etc/init.d directory and enter 


./novell-ncs stop 
+ At the command prompt, enter 
renovell-ncs stop 


4 Verify the cluster status: 
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cluster status 


5 If you get in a state where the node has not joined the cluster and Novell Cluster Services cannot 
be stopped: 


5a Disable autostart on reboot. Enter 
chkconfig novell-ncs off 


5b Reboot the server. 


5c Start Novell Cluster Services manually. Enter 
renovell-nes start 


5d Diagnose why the node had trouble joining the cluster. 
5e (Optional) Re-enable autostart for the node. Enter 


chkconfig novell-ncs on 


9.1.3 Enabling and Disabling the Automatic Start of Novell 
Cluster Services 


Novell Cluster Services automatically starts by default after it is installed and on server reboot. 
To cause Novell Cluster Services to not start automatically after a server reboot: 


1 Open a terminal console, then log in as the root user. 


2 Enter the following at a Linux terminal console: 
chkconfig novell-ncs off 


3 Reboot the server. 


4 After rebooting, you must manually start Novell Cluster Services by entering 
renovell-nes start 
To cause Novell Cluster Services to resume starting automatically after a server reboot: 


1 Open a terminal console, then log in as the root user. 


2 Enter the following at a Linux terminal console: 
chkconfig novell-ncs on 


3 Reboot the server. 
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9.2 Taking the Cluster Down 


The cluster down command concurrently removes all cluster nodes from the cluster. This command 
has the same effect as executing the cluster leave command on every server in the cluster. You 
are prompted to confirm the cluster down. For example, you might need to take the cluster down if an 
SBD partition fails, and you need to delete and recreate an SBD partition. 


1 Log in as the root user on any node in the cluster, then enter the following at a command 
prompt: 


cluster down 


2 When you are prompted to confirm the cluster down command, specify Yes, then press Enter. 


9.3 Selecting a Cluster to Manage 


1 Log in to iManager as a cluster administrator. 
2 In Roles and Tasks, select Clusters > My Clusters. 


The My Clusters page displays your personalized list of clusters in the tree that you want to 
manage. To add or remove clusters from your list, see Section 8.2, “Setting Up a Personalized 
List of Clusters to Manage,” on page 117. 


The Clusters plug-in sends a status query to the master IP address of each cluster in the list. 


3 If the master IP address of a cluster has connection problems, the Clusters plug-in allows you to 
use the server IP address of a node (preferably the master node) to manage the cluster and fix 
the problem. 


On the My Clusters page, if the cluster status query fails: 
3a Read the message about the problem connecting to the master IP address. 


The message appears each time that you revisit the My Clusters page until you resolve the 
IP address conflict on the network or by modifying the cluster’s master IP address. 


Failed to retrieve status information 
about cluster clusl via master IP 
address 10.10.10.242. 


Do you want to select a cluster node 
(preferably the master node) to manage the 
cluster? 


Please note that the selection will be 


temporary. You need to select again 
whenever "My Clusters" page loads. 


Please use this opportunity to fix the master 
IP address. 


3b Do one of the following: 


+ Use a server node (preferably the master): Click Yes to agree to use the server IP 
address of a node to temporarily manage the cluster. 
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+ View error details: Click No to view the Cluster Communication Error details. It 
provides some tips for diagnosing the root cause of the IP address conflict. Click OK to 
dismiss the message. Try to resolve the conflict on the network, then select Clusters > 
My Clusters to see if the connection issue is resolved. 


A Error: Cluster Communication Error 


An error occurred while communicating between iManager and the CIMOM broker running on the cluster master node. 
Click the "More Info” button below for the full stack trace. 


Summary: 
Error: 316009-12 (BROKER_ERROR_NO_ROUTE_TO_HOST) - No route to host (10.10,10.242) 


Diagnosis: 


This error signals that a problem occurred while attempting to make a socket connection to the cluster at IP address: 
10.10.10.242 and port: 5989. Typically this error occurs because the IP address for the cluster cannot be reached 
from the iManager server possibly because of an intervening firewall, or if an intermediate router is down. It can also 

occur when the master IP address resource is down, or there are no nodes in the cluster. 


Suggestions: 
The following suggestions may help to further narrow dowm or resolve the problem: 


+ Verify the cluster IP address is correct: 10.10.10.242. First, check "NCS:Network Address” attribute and make 
sure the hex translates into the IP Address for the Master IP Resource, Next, check the "Network Address” 
attribute which has the TCP and UDP port 524 addresses for the Master IP Resource address as well. These 
addresses should match the "NCS:Network" address. If these addresses differ, manually change them to match. 
This could be the case if the IP address was ever changed on the cluster. 

Verify the ability to connect to the cluster master node by pinging the cluster IP address from a terminal on 

the iManager server. 

+ Confirm that the IP address for the "Master IP Address” Resource is bound to the master node. On the console, 
type: “ip addr show | grep secondary” and you should see it bound. The Master IP address needs to be the same 
in the cluster load and unload scripts, and in the attributes of the cluster object in "NCS:Network Address” and 
“Network Address” with UOP and TCP. 


+ If you are still getting this error, click the “More Info” button below, and copy and paste the contents in an 
email to Novell Technical Support. 


OK | _ More Info 
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3c Browse to choose the node (preferably the master node) to use to temporarily manage the 
cluster, then click OK. 


Browse Search 
Contents: jbt-cictt carta seecten range) 
Look in: 


novel Eanan 
(Geovepde: rostl) r"a 
a 


Loak for objects named asks, 
(Seawnpde: A, Low” Rte 


Look tor these types 
NOP Sever 


Atare Bosena 
Lead Coppin 


ie Cwis 


trn text D 


Selected Objects: 1 Kich object ureei 


D spores 


on Ces Atl 


3d If you need to modify the master IP address to fix the connection problem, see Section 8.12, 
“Viewing or Modifying the Cluster Master IP Address or Port,” on page 139. 


4 After a successful connection to the cluster master IP address, do any of the following: 


¢ Cluster Properties: To view or manage the cluster policies, protocols, or properties, select 
the check box next to the cluster, then select Action > Edit Properties. 


The Cluster Properties dialog box opens. The browser’s pop-up blocker must be disabled. 
See the following: 


¢ Section 8.4, “Configuring Quorum Membership and Timeout Policies,” on page 124 
¢ Section 8.5, “Configuring Cluster Protocols,” on page 125 
¢ Section 8.6, “Configuring Cluster Event Email Notification,” on page 127 

¢ Resources: To manage cluster resources, click the cluster name link. 


The browser opens on the Cluster Manager page in the same browser window. See 
Chapter 10, “Configuring and Managing Cluster Resources,” on page 193. 


+ Cluster Report: To generate a report for the cluster, select the check box next to the 
cluster, then select Action > Run Report. 


The Cluster Report dialog box opens. The browser’s pop-up blocker must be disabled. See 
Section 9.9, “Generating a Cluster Configuration Report,” on page 165. 


+ Repair a NetWare Cluster: To repair a NetWare cluster, select the check box next to the 
cluster, then select Action > Repair. 


This option is useful if you are replacing an existing NetWare server. Install the NetWare 
operating system and Novell Cluster services on the new server, and name server with the 
same name as the old server. Choose the Repair option to automatically configure Novell 
Cluster Services on the replacement server. You must manually copy the 1dncs.nef and 
uldnes.ncf files from the sys:\system directory to this node from another node in the 
cluster. 


+ Repair an OES Linux Cluster: To repair an OES cluster, select the check box next to the 
cluster, then click Action > Repair. 
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The Repair option is useful when you see a mismatch in the cluster resource list or the 
resource priority list. The cluster repair will make the resource list consistent with the 
resource objects. 


For example, if the cluster status command output is blank or the deleted resources are still 
listed, the repair option will make the resource list match the resource objects. Resources 
will then be displayed properly in CLI and iManager. 


NCS logs the corresponding repair option messages in the /var/opt /novell/log/ncs/ 
repair.log file. 


9.4 Monitoring Cluster and Resource States 


The Cluster Manager page in iManager gives you important information about the status of servers 
and resources in your cluster. 


1 In iManager, select Clusters > My Clusters. 
View the overall status of the each of the clusters in your list. 
2 In your personalized My Clusters list, select the name of the cluster you want to manage. 


If the cluster does not appear in your list, add the cluster to your list as described in Section 8.2, 
“Setting Up a Personalized List of Clusters to Manage,” on page 117. 


3 View the status of the cluster nodes and resources. 
My Clusters > clusterl.Servers.novell 


è cluster1.Servers.novell 2) 


esa EET Ts) BCC Manager \ Cluster Event Log \ Cluster Options 
Run rt 
Epoch: 5 


& 6 B 


SYSTST-TS-94 SYSTST-TS-97 SYSTST-TS-149 


Online | Offline | Migrate | Respond to Alert | Refreshw 6 Item(s) 
Type §| Name State Location Lives Up Since 
4 Master IP_Address Resource @ Running SYSTST-TS-149 3 Apr 19, 2012 2:41:34 PM 
oP POOL_RAID10_ SERVER @® Running SYSTST-TS-149 2 Apr 19, 2012 2:41:58 PM 
© G& pool SH SERVER © FailoverAlert SYSTST-TS-94 1 


If scrolling is needed to view the complete list, you can use the Refresh option to set a longer 
refresh rate for the page in order to allow enough time to view the status for all items. 


Master Server 


The master server in the cluster is identified by a yellow diamond in the middle of the server 
icon &). The master server is initially the first server in the cluster, but another server can 
become the master if the first server fails. 

Operating State 
An icon next to the cluster resource or cluster indicates its operating state. Table 9-1 
describes each operating state and icon. When a resource is state is blank or has no 


colored icon, it is unassigned, offline, changing state, or in the process of loading or 
unloading. 
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Table 9-1 Operating States for a Cluster and Its Resources 


State Icon Description 


Normal @ A green ball indicates that the node is running, or 
the resource is online. 


Stopped e A red ball with a horizontal white line indicates that 
the node or resource is stopped and waiting for 
administrator intervention. 


Offline sD A white ball with a horizontal red line indicates that 
the node or resource is offline. 


Critical x A white ball with a red X indicates that the node has 
failed, the resource is comatose, or a resource ina 
My Resources list cannot be not found (renamed or 
deleted). 


Warning > A white ball with a yellow diamond indicates that an 
alert condition has occurred, and the resource 
needs administrator attention. 


Unknown oy) A yellow ball with a question mark indicates that the 
° state of the node or resource cannot be determined. 
Either the server is not currently a member of the 
cluster or its state is unknown. 


Epoch 


The Epoch number indicates the number of times the cluster state has changed. The cluster 
state changes every time a server joins or leaves the cluster. 


Cluster Resource States 


Table 9-2 identifies the different resource states and gives descriptions and possible actions 
for each state. 


Table 9-2 Cluster Resource States 


Resource State Description Possible Actions 

Alert Alerts can result if the Start mode, On the Cluster Manager page in 
Failover mode, or Failback mode for iManager, select the check box next 

Alert types are: the resource has been set to Manual. to the resource, click the Respond to 


The resource is waiting for the Alert option, then resolve the alert. 
administrator to intervene to start, fail Depending on the resource state, 
over, or fail back the resource on the you are prompted to start, fail over, or 
Start Alert specified server. fail back the resource. See 

Section 9.5, “Responding to a Start, 
Failover, or Failback Alert,” on 

page 159. 


Failback Alert 
Failover Alert 


After you clear the Start Alert, you 
can take the resource offline, then 
bring the resource online. 
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9.5 


Resource State 


Description 


Possible Actions 


Comatose The resource is not running properly Click the Comatose status indicator 
and requires administrator and take the resource offline. After 
intervention. resource problems have been 

resolved, you can bring the resource 
online (return it to the running state). 
A comatose resource cannot be 
taken directly to an online state. 

Loading The resource is in the process of None. 
loading on a server. 

NDS_Sync The properties of the resource have None. 
changed and the changes are still 
being synchronized in eDirectory. 

Offline Offline status indicates the resource If desired, you can click the Offline 


is shut down or is in a dormant or 
inactive state. 


status indicator and click the Online 
button to load the resource on the 
best node possible, given the current 
state of the cluster and the resource's 
preferred nodes list. 


Quorum Wait 


The resource is waiting for the 
quorum to be established so it can 
begin loading. 


None. 


Running The resource is in anormal running You can click the Running status 

state. indicator and choose to either 
migrate the resource to a different 
server in your cluster or unload (bring 
offline) the resource. 

Unassigned There is not an assigned node If desired, you can click the 
available that the resource can be Unassigned status indicator and 
loaded on. offline the resource. Offlining the 

resource prevents it from running on 
any of its preferred nodes if any of 
them join the cluster. 

Unloading The resource is in the process of None. 


unloading from the server it was 
running on. 


Responding to a Start, Failover, or Failback Alert 


You might receive an alert (©) for a resource if you have configured the resource’s Start mode, 
Failover mode, or Failback mode settings to Manual. The alert types correspond to the mode setting: 


+ Start Alert 
+ Failover Alert 
+ Failback Alert 


The resource is waiting for the administrator to intervene to start, fail over, or fail back the resource on 


the specified server. 
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If you attempt to offline a resource that is in the Start Alert state, nothing happens and the following 


message is displayed: 


This operation cannot be completed. It is only available when the resource is in an 


offline state. 


You must clear the Start Alert before you can offline the resource. After the resource is offline, you 


can online the resource. 


To respond to an alert: 


1 In iManager, select Clusters > My Clusters. 


If the cluster you want to manage does not appear in your list, add the cluster to your list as 
described in Section 8.2, “Setting Up a Personalized List of Clusters to Manage,” on page 117. 


In your personalized list of clusters, a critical (%)) status for a cluster indicates that a resource 
might be in a comatose state and require administrator intervention. Click the resource name to 
manage the resource. 


My Clusters 2 


The list below provides a convenient way to keep track of clusters you frequently manage. Click on the add button to browse for clusters in the tree, and select them to be added to the list 


My Clusters 


Add Remove Action ~ Refresh 


|| Status Name Master Node IP Address Nodes Epoch BCC 
EJ > cluster1 gs SYSTST-TS-149 10.10.183.220 2/3 5 


On the Cluster Manager page, select the check box next to the resource that has the alert, then 
click Respond to Alert. 


My Clusters > clusterl.Servers.novell 


 cluster1.Servers.novell 2 


View the status ot both servers and resources in the cluster. You can also migrate cluster resources to different servers in the cluster, or change the state of resources to offline or online 


f Cluster Manager Y BCC Manager \ Cluster Event Log \ Cluster Options \ 
Run Report 


Epoch: 5 


E 8 8 


SYSTST-TS-94 SYSTST-TS-97 SYSTST-TS-149 


Online | Offline | Migrate | Respond to Alert | Refresh» 6 Item(s) 
Type §| Name State Location Lives Up Since 
& Master_IP_Address Resource @ Running SYSTST-TS-149 3 Apr 19, 2012 2:41:34 PM 
a POOL_RAID10_SERVER @ Running SYSTST-TS-149 2 Apr 19, 2012 2:41:58 PM 


@ &  poot_sh SERVER © FailoverAlert SYSTST-TS-94 1 
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4 On the Respond to Alert page, click Yes, No, or Cancel to perform the desired action for the 
selected resource’s alert state. 


My Clusters > cluster] Servers.novell > Respond to Alert 
Respond to Alert ? 


Click Yes, No, or Cancel to perform the desired action for the selected resources 


Selected Resources 


Name State Yes Action No Action Cancel Action 


POOL_SH_SERVER © Failover to next available node Offline resource Stay in Alert state 


Do you want to continue? 


5 After clearing a Start Alert, go to the Cluster Manager page, select the check box next to the 
resource, then click Offline. After the resource is offline, select the check box again and click 
Online to bring the resource online. 


Viewing the Cluster Event Log in iManager 


The Cluster Event Log in Clusters-plug for iManager lets you view recent cluster events logged in the 
/admin/Novell1/Cluster/EventLog.xm1 file. Events can be node specific (a node joins the cluster 
or leaves the cluster) or they can be resource specific (a resource comes online or goes offline). 


By default, the Cluster Event Log displays 10 most recent events (newest to oldest) for all severity 
levels, all nodes, and all resources. You can use the Cluster Event Log Filter page to filter out events 
that are not of interest so that only the desired log entries are displayed in the report. You can filter out 
events according to these categories: 


¢ Severity (Error, Normal, Warning) 
+ Node (by node name) 


¢ Resource (by resource name) 


Selecting a check box causes that entry type to appear in the log. Deselecting a check box filters out 
the associated entry type. 


In the Event Log Range section of the filter, you can choose to report all events in the log, or you can 
get a report of logged events that occurred during a specified time range. The time range filter 
displays events that occurred during the interval of time before a specified date and time and after a 
specified date and time. For example, you might want to see events that occurred for a cluster 
resource before the date/time that a failover event was triggered and after the date/time of its 
previously known good state. By default, the After field displays the date and time of the most recent 
logged entry, and the Before field displays the date and time of the oldest available logged entry. The 
search includes the specified before and after date/time values. If you specify date/time values 
outside the range of entries that are available, the filter applies the default range. 


In the Details section of the filter, you can control how many event log messages are displayed per 
page. The default is 10 events per page. If the number of entries for your search exceeds one page, 
you can click the right-arrow button and left-arrow button to page through the report. Click the double- 
left-arrow button to jump to the first page of the report. Click the double-right-arrow button to jump to 
the last page of the report. 


In the Details section of the filter, you can also choose whether the log message portion of a log entry 
is displayed in the log. 
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To view the logged cluster events: 


1 In iManager, select Clusters > My Clusters, then select the cluster. 
2 Select the Cluster Event Log to view the latest cluster events. 
Ten most recent events are displayed by default in reverse chronological order. 


My Clusters > cl134.ncs.novell 


$ cl134.ncs.novell 2 


Use the Cluster Event Log to view recent cluster events. Events can be node specific (a node joined or left the cluster) or they can be resource specific 
(a resource changed state from loading to running) 


Cluster Manager \ BCC Manager f- AJJIF Cluster Options | 


Filter | Clear Filter | Clear Log 10 Item(s) 
Timestamp Node Resource Severity Cluster Event 

May 30, 2013 11:52:02 AMMDT LXVOLG_resource @ Normal Running on avalon 
May 30, 2013 11:51:57 AMMDT Master_IP_Address_Resource @) Normal Running on avalon 
May 30, 2013 11:51:56 AMMDT LXVOLF_resource @ Normal Running on avalon 
May 30, 2013 11:51:55 AMMDT lvm24S5 (@ Normal Running on avalon 
May 30, 2013 11:51:53 AMMDT LXVOLG_resource @ Normal Loading on avalon 
May 30, 2013 11:51:53 AMMDT POOLD_SERVER @ Normal Running on avalon 
May 30, 2013 11:51:39 AMMDT POOLD_SERVER @ Normal Loading on avalon 
May 30, 2013 11:51:39 AMMDT lvm245 @ Normal Loading on avalon 
May 30, 2013 11:51:39 AMMDT LXVOLF_resource @ Normal Loading on avalon 
May 30, 2013 11:51:39 AMMDT Master_IP_Address_Resource (@) Normal Loading on avalon 

Print Close 


3 (Optional) Generate a custom event report. 
3a At the top of the Cluster Event Log page, click Filter to open the Event Log Filter page. 


My Clusters > ¢134.ncs.novell > Event Log Filter 

Event Log Filter [2] 
Modify log attributes. Change the severity of logged events. Filter out nodes and resources 

Severi Node 
Types | Name 

Error avalon 

M1) Normal M pemberly 

M Warning V| stratford 


Resource 


M Name fe) 


| Master_IP_Address_Resource 
M) POOLD_SERVER 
| LXVOLF_resource 
| LXVOLG_resource 


Event Log Range Details 
O Entire Log Number ofMessages to Display: [10 | 
® Time Range (inclusive) Display Log Messages 


before Fri 31 May 2013 06:07:41 PM MDT 


a 


after Fri 31 May 2013 06:07:22 PM MDT (zal 


OK Close 


3b In the Security section, deselect the check box next to message types that are not of 
interest. 


+ Error 
+ Normal 
+ Warning 


For example, deselect Normal to omit normal events. Only error and warning messages will 
appear in the report. 
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3c 


3d 


3e 


3f 


3g 
3h 


In the Node section, deselect the check box next to nodes that are not of interest. Only 
events for selected nodes will appear in the report. 


In the Resource section, deselect the check box next to cluster resources that are not of 
interest. Only events for selected resources will appear in the report. 


In the Event Log Range section, select one of the following: 
+ Entire log 
+ Time range (inclusive) 
¢ Before this date/time 
+ After this date/time 


In the Details section, specify how many messages to display per page and whether the log 
message portion of a log entry is displayed in the report. 


Click OK to apply the filter. 
View the custom report. 


For example, the following report shoes only error or warning messages for the 
POOLD_ SERVER Cluster resource that appear in the entire log. 


My Clusters > cl134.ncs.nove 


cl134.ncs.novell ? 


Cluster Manager \ BCC Manager f Cluster Event Log \ STE) Cluster Options 


Filter | Clear Filter | ClearLog 4 Item(s) 
Timestamp Node Resource Severity Cluster Event 
April 11, 2013 1:41:53 PMMDT POOLD_SERVER © Warning Unassigned on unknown 
April 11, 2013 1:41:52 PMMDT POOLD_SERVER © Warning NDS Sync on unknown 
April 11, 2013 1:03:11 PMMDT POOLD_SERVER © Warning Unassigned on unknown 
April 11, 2013 1:03:07 PMMDT POOLD_SERVER © Warning NDS Sync on unknown 
Print Close 


4 Click Clear Filter to clear the current filter. 


5 (Optional) Click Clear Log to remove all entries from the log. 


All prior log entries are deleted and are no longer available. 


Viewing the Cluster Event Log at the Command 


Line 


You can view cluster events logged in the /admin/Novell/Cluster/EventLog.xml file by copying 
the /admin/Novell/Cluster/EventLog.xm1 file to a working location, and using the cat command 
to display the file. 


1 Log in to the node as the root user, then open a terminal console. 
2 Enter 


cp /admin/Novell/Cluster/EventLog.xml /tmp/ 


cat 


/tmp/EventLog.xml 
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This returns the log content in an XML format. For example: 


<logEntry> 
<timeStamp> 5/12/2013 23:28:38</timeStamp> 
<node>CG-03</node> 
<clusterEvent>Joined at epoch 2</clusterEvent> 


</logEntry> 


<logEntry> 
<timeStamp> 5/12/2013 23:27:16</timeStamp> 
<resource>Master_ IP Address Resource</resource> 
<clusterEvent>Running on CG-01</clusterEvent> 
</logEntry> 


<logEntry> 
<timeStamp> 5/12/2013 23:27:15</timeStamp> 
<node>CG-02</node> 
<clusterEvent>Joined at epoch 1</clusterEvent> 
</logEntry> 


<logEntry> 
<timeStamp> 5/12/2013 23:14:32</timeStamp> 
<resource>Master_IP Address Resource</resource> 
<clusterEvent>Running on CG-01</clusterEvent> 
</logEntry> 


<logEntry> 
<timeStamp> 5/12/2013 23:14:19</timeStamp> 
<resource>Master_IP Address Resource</resource> 
<clusterEvent>Loading on CG-01</clusterEvent> 
</logEntry> 


<logEntry> 
<timeStamp> 5/12/2013 23:14:13</timeStamp> 
<node>CG-01</node> 
<clusterEvent>Joined at epoch 0</clusterEvent> 
</logEntry> 


9.8 Viewing Summaries of Failed or Incomplete 
Events from the *.out Log Files 


In OES 11 SP2 and later, you can use the DotOutParser utility (/opt /novell/nes/bin/ 
dotoutparser.p1l) print summaries of failed or incomplete events that have been recorded in a 
specified /var/opt /novell/log/nes/<resource_name>.<script>.out log file. It also prints output 
(if any) from any commands that failed or got stuck. It optionally includes line numbers, so you can 
easily refer the summary output to the source lines in the *. out file. The higher the level of verbosity 
you specify, the more information you get in the summary output. By default, it prints the entries with 
plus (+) variable assignments. See Section A.5, “DotOutParser Utility,” on page 459. 


1 Log in to the node as the root user. 


2 Copy the /var/opt/novell/log/ncs/<resource_name>.<script>.out log files of interest to 
a working location on the node. 


3 At a terminal console, enter 


/opt/novell/ncs/bin/dotoutparser.pl [-v|-vv|-vvv|-vvvv] /tmp/<resource_name>.<script>.out 
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For example: 


/opt/novell/ncs/bin/dotoutparser.pl -v /tmp/POOL_09 SERVER.load.out 


Fri May 3 11:51:59 2013 (#1): 
2: + exit_on_error nss /poolact=POOL_09 
9: + return 0 


10: + exit_on_error ncpcon mount VOL_092=237 

25: + return 0 

26: + exit_on_error ncpcon mount VOL_091=238 

41: + return 0 

42: + exit_on_error add_secondary_ipaddress 192.168.1.9 

94: + return 0 

95: + exit_on_error ncpcon bind --ncpservername=CLUSTER1_ POOL _09 SERVER --ipaddress=192.168.1.9 
97: ++ ncpcon bind --ncpservername=CLUSTER1 POOL 09 SERVER --ipaddress=192.168.1.9 
98: ... Executing " bind" 

99: 

100: Cannot bind server, failure reason = -632 

101: 

102: ... FAILED completion [elapsed time = 20 Seconds 2 msecs 671 usecs] 


107: + exit 1 


Generating a Cluster Configuration Report 


A cluster configuration report can help you diagnose problems with the cluster nodes and resources. 
The report contains the following information for the selected cluster: 


Field Description 

Cluster name The dot delimited distinguished name of the selected cluster (clustername.context). 
Date The date and time the report was generated. 

Cluster status Current Nodes 


Quorum Triggers 
List of resources (Name, State, Location, Lives, Up Since) 


Cluster options Quorum Triggers (Number of nodes, Timeout) 


Protocol Setting (Heartbeat, Tolerance, Master Watchdog, Slave Watchdog, 
Maximum retransmits) 


List of nodes (Name, State, Number, IP Address, and Distinguished Name) 
Resource Mutual Exclusion Groups 


Resource details Information listed (as it applies) by resource for the master IP address resource and 
each of the cluster resources: 


Policies (Follows masters, Ignore quorum, Start mode, Failover mode, Failback 
mode, Assigned nodes) 


Load script and timeout 
Unload script and timeout 
Monitor script 

Protocols 

Virtual server name 

CIFS server name 

IP address 

Advertising protocols 
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To generate a cluster configuration report: 


1 In iManager, select Clusters > My Clusters. 


2 In your personalized My Clusters list, select the check box next to the cluster you want to 
manage. 


If the cluster does not appear in your list, add the cluster to your list as described in Section 8.2, 
“Setting Up a Personalized List of Clusters to Manage,” on page 117. 


3 Click Action > Run Report. 


When you select Run Report, the generated report opens in a new window, instead of in the 
child frame. This allows you to print and save the report from any web browser. 


4 Use the scroll bar to view the report in the browser. 
5 (Optional) Use the browser options to print the report. 
6 (Optional) Save the report to a text file. 


Because some of the output is scripted, you must copy and paste the report content instead of 
using the browser’s File > Save as option. 


6a Click the cursor in the browser window where the report results are displayed, press Ctrl+A 
to select all, press Ctrl+C to copy the report to the clipboard. 


6b Ina text editor, open a new document, then press Ctrl+V to paste the report in the 
document. 


6c Save the report document. 


Repairing a Cluster 


Repair a NetWare Cluster: To repair a NetWare cluster, 


1 In iManager, select Clusters > My Clusters. 

2 In your personalized My Clusters list, select the check box next to the cluster you want to repair. 

3 Select Action > Repair. 
This option is useful if you are replacing an existing NetWare server. Install the NetWare operating 
system and Novell Cluster services on the new server, and name server with the same name as the 
old server. Choose the Repair option to automatically configure Novell Cluster Services on the 


replacement server. You must manually copy the 1dncs.ncf and uldnes.nct files from the 
sys: \system directory to this node from another node in the cluster. 


Repair an OES Linux Cluster: To repair an OES cluster, 


1 In iManager, select Clusters > My Clusters. 
2 In your personalized My Clusters list, select the check box next to the cluster you want to repair. 
3 Select Action > Repair. 


The Repair option is useful when you see a mismatch in the cluster resource list or the resource 
priority list. The cluster repair will make the resource list consistent with the resource objects. 


For example, if the cluster status command output is blank or the deleted resources are still listed, the 
repair option will make the resource list match the resource objects. Resources will then be displayed 
properly in CLI and iManager. 


NCS logs the corresponding repair option messages in the /var/opt /novell/log/ncs/repair.log 
file. 
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9.11.1 


9.11.2 


Onlining and Offlining (Loading and Unloading) 
Cluster Resources from a Cluster Node 


After a cluster resource is enabled, the load and unload scripts take care of starting and stopping the 
services or mounting and dismounting the volumes that are configured in the resource. You start 
services and mount devices by onlining the resource. You stop services and unmount devices by 
offlining the resource. 

¢ Section 9.11.1, “Guidelines for Onlining and Offlining Resources,” on page 167 

¢ Section 9.11.2, “Using iManager to Online and Offline Resources,” on page 167 

¢ Section 9.11.3, “Using the Cluster Online Command,” on page 168 

¢ Section 9.11.4, “Using the Cluster Offline Command,” on page 168 

¢ Section 9.11.5, “Using the Cluster Migrate Command,” on page 168 


Guidelines for Onlining and Offlining Resources 


Onlining a resource runs the load script, which loads the resource on its primary preferred node, or on 
an alternate preferred node if possible, according to the order in its Preferred Nodes list. No action is 
taken if the preferred nodes are not active in the cluster, or if there are Resource Mutual Exclusion 
conflicts on its active preferred nodes. 


Offlining a resource runs the unload script and unloads the resource from the server. The resource 
cannot be loaded on any other servers in the cluster and remains unloaded until you load it again. 


If monitoring is enabled for a resource and you start, stop, or restart services outside the cluster 
framework while the cluster resource is online, a monitoring failure occurs, which triggers a failover of 
the cluster resource. 


If you edit the scripts for a resource that is online, the changes you made do not take effect until the 
resource is taken offline and brought online again. 


If a resource is in a comatose state, you must take the resource offline before it can be brought online 
again. 


There are maintenance situations where you might need to control services by using the standard 
interfaces. In these rare cases, you must first offline the cluster resource, then use non-cluster 
methods to start and stop a service or mount and dismount a volume outside the cluster framework. 
When you are done, online the cluster resource to resume normal cluster handling. 


Using iManager to Online and Offline Resources 


1 In iManager, select Clusters > My Clusters. 
2 Select the cluster that you want to manage. 


If the cluster does not appear in your list, add the cluster to your list as described in Section 8.2, 
“Setting Up a Personalized List of Clusters to Manage,” on page 117. 


3 On the Cluster Manager page, select the check box next to the resource you want to manage, 
then click Online or click Offline. 
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9.11.5 


9.12 


Using the Cluster Online Command 


To bring a resource online on its most preferred node that is currently active: 
1 As the root user, enter the following at the command prompt of a cluster node: 
cluster online resource name 
To bring a resource online on a specific active node: 
1 As the root user, enter the following at the command prompt of a cluster node: 


cluster online resource name node_name 


Using the Cluster Offline Command 


To take a resource offline: 
1 As the root user, enter the following at the command prompt of a cluster node: 


cluster offline resource _ name 


Using the Cluster Migrate Command 


The cluster migrate command can be used to move a specified resource from the node where it is 
currently running to a another node. If a node name is not provided, the resource is brought online 
according to its Preferred Nodes list if it is possible.You can alternatively specify a destination node 
from its Preferred Nodes list that is running in the cluster. It migrates the resource to the specified 
node if it is possible. No action is taken if the specified node is not in the resource’s preferred nodes 
list, there is a Resource Mutual Exclusion conflict on the specified node, or the specified node is not 
currently active in the cluster. 


1 As the root user, enter the following at the command prompt of a cluster node: 


cluster migrate resource _ name [node_name] 


Cluster Migrating Resources to Different Nodes 


You can migrate cluster resources to different servers in your cluster without waiting for a failure to 
occur. You might want to migrate resources to lessen the load on a specific server, to free up a server 
so it can be brought down for scheduled maintenance, or to increase the performance of the resource 
or application by putting it on a faster machine. The node you choose must be in the resource’s 
preferred nodes list and available to run the resource. 


Migrating resources lets you balance the load and evenly distribute applications among the servers in 
your cluster. 


Using iManager 


1 In iManager, select Clusters > My Clusters. 
2 Select the cluster that you want to manage. 


If the cluster does not appear in your list, add the cluster to your list as described in Section 8.2, 
“Setting Up a Personalized List of Clusters to Manage,” on page 117. 
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3 On the Cluster Manager page, select the check box next to the resource you want to cluster 
migrate, then click Migrate. 


A page appears, displaying a list of possible servers that you can migrate this resource to. 


4 Select a server from the list to migrate the resource to, then click OK to migrate the resource to 
the selected server. 


Using Console Commands 
1 As the root user, enter the following at the command prompt of a cluster node: 
cluster migrate <resource name> {<node_name> | -list | -most | -next} 


Migrates the specified resource from the node where it is currently running to the node you 
specify in the command. The node you migrate the resource to must be running in the cluster 
and also be in the resource’s Preferred Nodes list. 


Options 
<node_name> 


Migrates the resource to the specified node if possible. No action is taken if the specified 
node is not in the resource’s preferred nodes list, there is a Resource Mutual Exclusion 
conflict on the specified node, or the specified node is not currently active in the cluster. 


-1, -list 
Shows the preferred nodes list for the specified resource. 
-m, -most 


Migrates the specified resource to the most preferred node currently in the cluster. If the 
resource is running on such a node, no action is taken. 

-n, -next 
Migrates the resource to the node in the preferred node list that is next in order to the node 
where the resource is currently running. If there is no next node or all such nodes are not in 
the cluster currently, it searches from the beginning of the resource’s preferred nodes list. 


No action is taken if a new destination could not be determined after the search is 
exhausted. 


Examples 


Move res1 from the current node to nodez2 in the resource’s preferred nodes list. The resource is 
migrated only if there are no Resource Mutual Exclusion conflicts on the target node. 


cluster migrate resl node2 
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List the preferred nodes for resource AUTO POOL 14 SERVER. 
cluster migrate AUTO POOL 14 SERVER -1 


Preferred nodes for resource ‘AUTO_POOL 14 SERVER' 
CG-06 
CG-05 
CG-04 
CG-03 
CG-02 
CG-01 
CG-08 
CG-07 


Status for Resource: AUTO POOL 14 SERVER 


Running on CG-05 Lives: 65 
Revision: 5 


9.13 Removing (Leaving) a Node from the Cluster 


When a node leaves a cluster, the node is no longer visible to the other nodes in the cluster. You 
might want a node to leave the cluster to perform maintenance on the server, or to upgrade the server 
during a rolling cluster upgrade. 


¢ Section 9.13.1, “Removing One Node at a Time,” on page 170 
¢ Section 9.13.2, “Removing All Nodes at the Same Time (Taking the Cluster Down),” on page 170 


9.13.1 Removing One Node at a Time 


The cluster leave command allows you to remove a node from a cluster so that the node is not 
visible to other servers in the cluster. 


1 Log in as the root user on the node in the cluster that you want to remove, then enter the 
following at a command prompt: 


cluster leave 
After the node has successfully left the cluster, the following message is displayed: 


No longer a member of cluster cluster name 


9.13.2 Removing All Nodes at the Same Time (Taking the Cluster 
Down) 


The cluster down command removes all cluster nodes from the cluster. This command has the 
same effect as executing the cluster leave command on every server in the cluster. You are 
prompted to confirm the cluster down. 


1 Log in as the root user on any node in the cluster, then enter the following at a command 
prompt: 


cluster down 


2 When you are prompted to confirm the cluster down command, specify Yes, then press Enter. 
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Joining a Node to the Cluster (Rejoining a Cluster) 


The cluster join command allows you to add a node back to the cluster so that the node is again 
visible to other servers in the cluster. 


While the node is not active in the cluster, any changes in storage objects are not updated 
automatically for the node. For example, the following storage object changes are automatically 
updated only for nodes that are currently active in the cluster: 

¢ Creating, deleting, or expanding a clustered NSS pool 

¢ Creating, deleting, or expanding a clustered LVM volume group 

+ Adding or removing segments in an NSS software RAID (that is used by a clustered NSS pool) 

¢ Creating, mirroring, or re-creating an SBD partition 

+ Creating or deleting shared partitions 
If Novell Cluster Services is configured to autostart when a server is restarted, a node that has left the 
cluster automatically rejoins the cluster on reboot. A server restart automatically rescans devices, 
rescans storage objects, and remaps multipath devices. Thus, if you reboot a node that has left the 


cluster, a node automatically recognizes any storage object changes made while the node was not 
active in the cluster. 


To rejoin a cluster without rebooting the server: 


1 Log in as the root user on the server that you want to join the cluster, then enter the following at 
a command prompt: 


cluster join 


2 (Storage object changes) If you modified shared storage objects while the node was not active in 
the cluster, you must rescan the storage objects in order for the node to recognize these 
changes: 


2a Log in to the node as the root user and open a terminal console. 


2b Scan for storage object changes. At the command prompt, enter 


nivm rescan 


Shutting Down Novell Cluster Services When 
Servicing Shared Storage 

If you need to power down or recycle your shared storage system (Such as when you apply firmware 
changes to a SAN), you should shut down Novell Cluster Services prior to doing so. One way to do 


this is to use the cluster down command on any of the nodes in the cluster. You are prompted to 
confirm the cluster down. 
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9.16 Enabling or Disabling Cluster Maintenance Mode 


Cluster maintenance mode lets you temporarily suspend the cluster heartbeat while hardware 
maintenance is being performed. This is useful if you want to reset or power down the LAN switch 
without bringing down cluster servers. 


Enabling the cluster maintenance mode from one cluster node puts the entire cluster in maintenance 
mode. 


1 Log in as the root user to a node in the cluster, then enter the following at a command prompt: 
cluster maintenance on 


If the master server in the cluster is up, disabling the cluster maintenance mode from one cluster 
node brings the entire cluster out of maintenance mode. If the master server in the cluster goes down 
while the cluster is in cluster maintenance mode, you must disable cluster maintenance mode on all 
remaining cluster nodes in order to bring the cluster out of maintenance mode. 


1 Log in as the root user to a node in the cluster, then enter the following at a command prompt: 


cluster maintenance off 


9.17 Viewing the Cluster Node Properties 


You can view the cluster node number and IP address of the selected node as well as the 
distinguished name of the Linux Server object. 

1 In iManager, select Clusters > My Clusters. 

2 Click the cluster that you want to manage. 


If the cluster does not appear in your list, add the cluster to your list as described in Section 8.2, 
“Setting Up a Personalized List of Clusters to Manage,” on page 117. 


3 Select Cluster Options. 


4 Select the check box next to the cluster node whose properties you want to view, then click the 
Details link. 


My Clusters > clusi.ncs.novell > avalor 


U avalon z] 


View the general properties of this cluster node 


A 


Distinguished Name: avalon 
Node Number: [°] 
IP Address: 10.10.10.37 


OK 


5 View the node information: 
+ Distinguished Name: The distinguished name of the Server object. 
+ Node Number: The cluster node number. 
+ IP Address: The IP address of the server. 


6 Click OK to return to the Cluster Options page. 
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9.18.1 


Creating or Deleting Cluster SBD Partitions 


If a single node (or group of nodes) somehow becomes isolated from other nodes, a condition called 
split brain results. Each side believes the other has failed, and forms its own cluster view that 
excludes the nodes it cannot see. Neither side is aware of the existence of the other. If the split brain 
is allowed to persist, each cluster will fail over the resources of the other. Since both clusters retain 
access to shared disks, corruption will occur when both clusters mount the same volumes. 


Novell Cluster Services provides a split-brain detector (SBD) function to detect a split-brain condition 
and resolve it, thus preventing resources from being loaded concurrently on multiple nodes. The SBD 
partition contains information about the cluster, nodes, and resources that helps to resolve the split 
brain condition. 


Novell Cluster Services requires an SBD partition for a cluster if its nodes use physically shared 
storage. Typically, you create the SBD when you configure the cluster on the first node. You can 
alternatively configure an SBD for the cluster after you configure the first node, but before you 
configure Novell Cluster Services on the second node of the cluster. You might also need to delete 
and re-create an SBD partition if the SBD becomes corrupted or its device fails. 


An SBD must exist and the cluster must be enabled for shared disk access before you attempt to 
create shared storage objects in a cluster, such as pools and volumes. Novell Linux Volume Manager 
(NLVM) and other NSS management tools need the SBD to detect if a node is a member of the 
cluster and to get exclusive locks on physically shared storage. 


This section describes how to use the Novell Cluster Services SBD Utility (ďsbduti1) to create and 
delete SBD partitions. 
¢ Section 9.18.1, “Requirements and Guidelines for Creating an SBD Partition,” on page 173 
¢ Section 9.18.2, “Before You Create a Cluster SBD Partition,” on page 175 
¢ Section 9.18.3, “Creating a Non-Mirrored Cluster SBD Partition with SBDUTIL,” on page 176 
¢ Section 9.18.4, “Mirroring an Existing SBD Partition with NSSMU,” on page 179 
¢ Section 9.18.5, “Creating a Mirrored Cluster SBD Partition with SBDUTIL,” on page 183 
¢ Section 9.18.6, “Removing a Segment from a Mirrored Cluster SBD Partition,” on page 186 
¢ Section 9.18.7, “Deleting a Non-Mirrored Cluster SBD Partition,” on page 188 
¢ Section 9.18.8, “Deleting a Mirrored Cluster SBD,” on page 189 
¢ Section 9.18.9, “Additional Information about SBD Partitions,” on page 190 


Requirements and Guidelines for Creating an SBD Partition 


Consider the requirements and guidelines in this section when you create a Novell Cluster Services 
SBD (split-brain detector) partition for an existing cluster. 


IMPORTANT: Check to see if a cluster SBD partition already exists before you create a new one. 
See Section 9.18.2, “Before You Create a Cluster SBD Partition,” on page 175. 


+ “Preparing Novell Cluster Services” on page 174 

+ “Using a Shared Disk System” on page 174 

+ “Preparing a SAN Device for the SBD” on page 174 

¢ “Initializing and Sharing a Device for the SBD” on page 174 
+ “Working with NLVM Commands in a Cluster” on page 174 


Managing Clusters 173 


174 


+ “Determining the SBD Partition Size” on page 175 
+ “Replacing an Existing SBD Partition” on page 175 


Preparing Novell Cluster Services 


Before you create an SBD partition for an existing cluster, you must take the cluster down and stop 
Novell Cluster Services software on all nodes. Do not restart Novell Cluster Services and rejoin nodes 
to the cluster until after you create the new SBD and configure the Shared Disks flag attribute for the 
Cluster object. 


You can mirror an existing SBD while the cluster is up and running. 


Using a Shared Disk System 


You must have a shared disk system (such as a Fibre Channel SAN or an iSCSI SAN) connected to 
your cluster nodes before you create a split-brain-detector (SBD) partition. See Section 4.8, “Shared 
Disk Configuration Requirements,” on page 64 for more information. 


Preparing a SAN Device for the SBD 


Use the SAN storage array software to carve a LUN to use exclusively for the SBD partition. The 
device should have at least 20 MB of free available space. Connect the LUN device to all nodes in the 
cluster. 


For device fault tolerance, you can mirror the SBD partition. Use the SAN storage array software to 
carve a second LUN of the same size to use as the mirror. Connect the LUN device to all nodes in the 
cluster. 


The device you use to create the SBD partition must not be a software RAID device. A hardware 
RAID configured in a SAN array is seen as a regular device by the server. 


If you attach new devices to the server while it is running, you should scan for new devices on each 
cluster node to ensure that the devices are recognized by all nodes. Log in as the root user, launcha 
terminal console, then enter 


nlvm -s rescan 


Initializing and Sharing a Device for the SBD 


Before you use sbdutil to create an SBD, you must initialize each of the SAN devices that you 
created for the SBD and mark each device as Shareable for Clustering. When you mark the device as 
Shareable for Clustering, share information is added to the disk in a free-space partition that is about 
4 MB in size. This space becomes part of the SBD partition. 


When the cluster is down and Novell Cluster Services is stopped, you can use NSSMU, the Storage 
plug-in for iManager, the nlvm init command, or an NSS utility called ncsinit to initialize a device 
and set it to a shared state. To minimize the risk of possible corruption, you are responsible for 
ensuring that you have exclusive access to the shared storage at this time. 


Working with NLVM Commands in a Cluster 


If you have physically shared storage and the SBD does not exist, NSS management tools cannot 
detect if the node is a member of the cluster and cannot get exclusive locks to the physically shared 
storage. In this state, you can use the -s NLVM option with NLVM commands to override the shared 
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locking requirement and force NLVM to execute the commands. To minimize the risk of possible 
corruption, you are responsible for ensuring that you have exclusive access to the shared storage at 
this time. 


Determining the SBD Partition Size 


You use the size option with the SBD Utility to specify the desired size of the SBD partition. You can 
specify how much free space to use for the SBD, or you can specify the -1 option to use the entire 
device (the maximum size). If you specify a device to use as a mirror, the same amount of space is 
used. If you specify to use the maximum size and the mirror device is bigger than the SBD device, 
you will not be able to use the excess free space on the mirror for other purposes. 


Because an SBD partition ends on a cylinder boundary, the partition size might be slightly smaller 
than the size you specify. When you use an entire device for the SBD partition, you can use the -1 
option as the size, and let the software determine the size of the partition. 


Replacing an Existing SBD Partition 


To replace an existing SBD partition, you must first delete the old SBD partition, and then create the 
new one. To reuse the SBD partition’s device, you must remove the SBD partition, then re-initialize 
and share the device. 


You must take the cluster down and stop Novell Cluster Services on all nodes before you delete the 
existing SBD partition. Do not restart Novell Cluster Services and rejoin nodes to the cluster until after 
you create the new SBD. 


Before You Create a Cluster SBD Partition 


Before you create a Novell Cluster Services SBD partition, you should ensure that an SBD does not 
already exist on your cluster. The new SBD partition is not recognized until the old partition is deleted. 
1 Log in as the root user to any node in the cluster, and launch a terminal console. 


2 At the command prompt, enter 
sbdutil -f 


The -£ option tells you whether an SBD partition exists for the cluster, and identifies the SAN 
device where the SBD partition is located. It returns Not Found if the SBD partition does not exist. 


3 If an SBD partition already exists, use one of the following methods to delete the existing SBD 
partition before attempting to create another one: 


+ Section 9.18.7, “Deleting a Non-Mirrored Cluster SBD Partition,” on page 188 
¢ Section 9.18.8, “Deleting a Mirrored Cluster SBD,” on page 189 
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9.18.3 Creating a Non-Mirrored Cluster SBD Partition with 
SBDUTIL 


If you did not create a cluster SBD partition during the Novell Cluster Services installation on the first 
node of the cluster, you can create it later by using the SBDUTIL utility (/opt /novell/nces/bin/ 
sbdutil). You might also need to delete and re-create an SBD partition if the SBD becomes 
corrupted or its device fails. See the man page for sbdutil for more information on how to use it. 


If a cluster partition does not exist, create one by using the SBDUTIL: 


1 Ensure that nobody else is changing any storage on any nodes at this time. 


Until the SBD exists and the cluster is set up for shared disk access, you are responsible for 
ensuring that you have exclusive access to the shared storage. 


2 Take the cluster down: 
2a Log in to any node in the cluster as the root user, then open a terminal console. 


2b At the command prompt, enter 
cluster down 


3 On each cluster node, stop Novell Cluster Services: 
3a Log in to the cluster node as the root user, then open a terminal console. 


3b At the command prompt, enter 
renovell-ncs stop 


3c After you have stopped Novell Cluster Services on all nodes, continue with the next step. 
4 Prepare a SAN device to use for the SBD partition: 


4a Use the SAN storage array software to carve a device to use exclusively for the SBD 
partition. 


4b Attach the device to all nodes in the cluster. 


4c On each node, log in as the root user and rescan for devices: 
nlvm -s rescan 


Use the -s NLVM option to override the shared locking requirement and force the command 
to execute. 


5 Log in to any node in the cluster as the root user, then open a terminal console. 
6 View a list of the devices and identify the leaf node name (such as sdc) of the SAN device that 
you want to use for the SBD partition. At the command prompt, enter 


nivm -s list devices 


Use the -s NLVM option to override the shared locking requirement and force the command to 
execute. 


The device information shows the leaf node name, the size, the amount of free available space, 
the partitioning format (such as MSDOS or GPT), the shared state (whether it is marked as 
Shareable for Clustering), and the RAID state (whether the device is an NSS software RAID 
device). Do not use an NSS software RAID for the device. 


For example, an uninitialized device reports a format of None and a shared state of No: 


sdc size=102.00MB free=0KB format=None shared=No RAID=No 
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7 Initialize and share the device. At the command prompt, enter 


nlvm -s init <device_name> format=msdos shared 


WARNING: Initializing a device destroys all data on the device. 


Replace device_name with the leaf node name (such as sdc) of the SAN device you want to use 
as the SBD partition. 


Specify a partitioning format of msdos. 
Specify the shared option to mark the device as Shareable for Clustering. 


Use the -s NLVM option to override the shared locking requirement and force the command to 
execute. 


You can list the devices to visually verify that the device is formatted and shared: 
nlvm -s list devices 
For example, the formatted device sdc reports a format of MSDos and a shared state of Yes: 
sdc size=102.00MB free=101.98MB format=MSDOS shared=Yes RAID=No 
8 As the root user, enter the following at the command prompt: 
sbdutil -c -n <cluster_name> -d <device_name> -s <size> 


For the -n option, replace cluster_name with the name of the cluster, such as cluster1. This 
name must match the name of an existing cluster that has a Cluster object in eDirectory. The 
name is case sensitive. 


For the -d option, replace device_name with the leaf node name of the device where you want to 
create the cluster partition, such as sdc. 


For the -s option, use one of the following methods for specifying the size of the SBD partition. 
For information about size requirements, see “Preparing a SAN Device for the SBD” on 
page 174. 


+ Specify a value: Replace size with the size (in MB) to use for the SBD partition. 
For example, the following command creates the /dev/nss/mycluster1.sbd partition with 
a size of 200 MB: 


sbdutil -c -n myclusterl -d sdc -s 200 


+ Specify -1: You can specify the size as -1 to use all free space on the device. This option 
allows Novell Cluster Services to use a whole disk/LUN (or LUNs) that you set aside for 
SBD. 


For example, the following command creates the /dev/nss/cl1.sbd partition on the CX4- 
LUNOOO device, and uses the entire device: 


sbdutil -c -n cll -d CX4-LUNOOO -s -1 


+ Use default size: If the -s option is not used, the default size is 8 MB. 


For example, the following command creates the /dev/nss/cl2.sbd partition on the sdd 
device with the default size of 8 MB: 


sbdutil -c -n cl2 -d sdd 


9 (Optional) You can use the sbdutil -f£ -s command to view the path of the SBD partition. 
10 Modify the Cluster object in eDirectory to enable its NCS: Shared Disk Flag attribute. 
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This step is required only if the cluster has never had an SBD partition. However, it does no harm 
to verify that the NCS: Shared Disk Flag attribute is enabled. 


10a In aweb browser, open iManager, then log in to the eDirectory tree that contains the cluster 
you want to manage. 


IMPORTANT: Log in as an administrator user who has sufficient rights in eDirectory to 
delete and modify eDirectory objects. 


10b Select Directory Administration, then select Modify Object. 


10c Browse to locate and select the Cluster object of the cluster you want to manage, then click 
OK. 


10d Under Valued Attributes, select the NCS: Shared Disk Flag, then click Edit. 


Modify Object: Jecluster.novell 


General 

Valued Attributes Unvalued Attributes 
GUID ACL 
modifiers Name E Audit:File Link 
NCS:CRM Quorum Certificate Validity Interval 
NCS:CRM Quorum Timeout Cross Certificate Pair 
NCS:CRM Resource Priority DirXML-Associations 
NCS:Email Addresses Equivalent To Me 
NCS:Email Fitter Last Referenced Time 
NCS:GIPC Heartbeat masvAuthorizedRange 
NCS:GIPC Master Watchdog masv Default Range 
NCS:GIPC Max Retransmits < masvProposedLabel 
NCS:GIPC Slave Watchdog NCS:CRM HMO Setting 
NCS:GIPC Tolerance NCS:CRM Load Script 
NCS:Network Address NCS:CRM Load Timeout 
NCS:Port Number NCS:CRM Unload Script 
NCS:Revision NCS:CRM Unload Timeout 
NCS:Shared Disk Flag NCS:GIPC Contig 
Network Address NCS:Node Isolation Script 
Object Class Other GUID 
Revision rbsAssignedRoles 
Used By lv] rbsAssignedRoles2 


10e Select (enable) the NCS: Shared Disk Flag check box, then click OK. 


Edit Attribute 


NCS:Shared Disk Flag 


a 
0K | Cei | 


10f Click Apply to save changes. 

11 On each cluster node, start Novell Cluster Services: 
11a Log in to the cluster node as the root user, then open a terminal console. 
11b At the command prompt, enter 
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renovell-nes start 


11c After you have restarted Novell Cluster Services on all nodes, continue with the next step. 


12 On each cluster node, join the cluster. At the command prompt, enter 
cluster join 


13 (Optional) Continue with Section 9.18.4, “Mirroring an Existing SBD Partition with NSSMU,” on 
page 179. 


9.18.4 Mirroring an Existing SBD Partition with NSSMU 


You can mirror an existing Novell Cluster Services SBD partition to provide device fault tolerance. It is 
not necessary to take the cluster down or stop the cluster software. 


This section describes how to use NSSMU to mirror the SBD partition. For information about using 
Novell Linux Volume Manager (NLVM) commands to mirror an SBD, see “Mirroring an Existing SBD 
Partition with NLVM” in the OES 11 SP3: NLVM Reference. 

1 Prepare a SAN device to use as the mirror segment for the SBD partition: 


la Use the SAN storage array software to carve a device that is at least the size of the existing 
SBD partition’s device. 


1b Attach the device to all nodes in the cluster. 
1c On each node, log in as the root user and rescan for devices: 
nlvm rescan 
2 Initialize and mark the device as Shareable for Clustering: 
2a Log in to any node of the cluster as the root user, then open a terminal console. 
2b Launch NSSMU: 


nssmu 


2c In the NSSMU Main Menu, select Devices and press Enter. 


2d Inthe Devices list, select the device that you want to use for the SBD mirror, press F3 to 
initialize the device, then press y (Yes) to confirm and continue. 


WARNING: Initializing a device destroys all of the data on it. 
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-F3=Imt FS=Refresh Fe=Share SpACE=Select/Unselect = 2 |=  F&ore 


2e Select the DOS partitioning scheme for the device, then press Enter. 
DOS supports devices up to 2 TB in size. GPT supports devices of any size. 


Wait for the page to refresh before continuing. 
2f Press F6 to mark the device as shareable for clustering. 


The Shareable for Clustering value changes from No to Yes. 


“F3=Imit F5=Refresh F6=UnShare SPACE=Select/Unselect = 2 = Pore 


2g Press Esc to return to the NSSMU Main Menu. 
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3 In NSSMU, mirror the SBD partition: 
3a Select Partitions from the NSSMU Main Menu. 


3b From the list of partitions, select the SBD partition that you want to mirror. The partition is 
named the same as the cluster with an .sbd extension, such as clusi1.sbd. 


3c Press F3 to open the dialog to create the RAID1 mirror. 
3d Type the cluster name (Such as clus1) for the RAID, then press Enter. 
This is the same name as the SBD partition but without the . sba extension. 


3e From the list of available devices, select a device to use as the second segment of the 
mirror, then press the space bar to choose it. 


When the device is selected, the asterisk next to the device stays there even if you move 
the cursor up and down in the list. 


3f Press F3 again to accept your selection and create the mirror. 
3g In the confirmation message, press y (Yes) to approve the RAID1 creation. 


The SBD partitions are renamed with the partition name, and now have the extension of 
.msbdo (mirrored SBD partition 0) and .msbd2 (mirrored SBD partition 1). 


For example, for a cluster named clus1, the mirrored SBD partitions are clus1.msbdo and 
clus1.msbdl. 
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3h Press Esc to return to the NSSMU Main Menu. 
4 In NSSMU, verify that the RAID1 device was created for the SBD: 
4a Select RAID Devices from the NSSMU Main Menu. 


4b Select the RAID1 device that you created to view details about the mirrored SBD device 
(such as clus1.sbd). 


4c View the RAID Status to ensure that synchronization has begun. 
Synchronization is complete when the status is Synchronized. 
5 Press Esc twice to exit NSSMU. 
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Creating a Mirrored Cluster SBD Partition with SBDUTIL 


You can create a mirrored Novell Cluster Services SBD partition to provide device fault tolerance for 
the SBD. You must take the cluster down and stop the cluster software. 


Use the procedure in this section to create a new mirrored SBD partition by using the sbduti1 utility. 
For information about using Novell Linux Volume Manager (NLVM) commands to create a new 
mirrored SBD partition, see “Creating a Mirrored SBD Partition with NLVM” in the OES 11 SP3: NLVM 
Reference. 

1 Ensure that nobody else is changing any storage on any nodes at this time. 


Until the SBD exists and the cluster is set up for shared disk access, you are responsible for 
ensuring that you have exclusive access to the shared storage. 


2 Take the cluster down: 
2a Log in to any node in the cluster as the root user, then open a terminal console. 


2b At the command prompt, enter 
cluster down 


3 On each cluster node, stop Novell Cluster Services: 
3a Log in to the cluster node as the root user, then open a terminal console. 


3b At the command prompt, enter 
renovell-ncs stop 


3c After you have stopped Novell Cluster Services on all nodes, continue with the next step. 
4 Prepare two SAN devices to use for the SBD partition: 


4a Use the SAN storage array software to carve two devices of equal size to use exclusively 
for the mirrored SBD partition. 


4b Attach the devices to all nodes in the cluster. 


4c On each node, log in as the root user and rescan for devices: 
nlvm -s rescan 


Use the -s NLVM option to override the shared locking requirement and force the command 
to execute. 


5 Log in to any node in the cluster as the root user, then open a terminal console. 
6 View a list of the devices and identify the leaf node name (such as sdc) of the two SAN devices 
that you want to use for the mirrored SBD partition. At the command prompt, enter 


nivm -s list devices 


Use the -s NLVM option to override the shared locking requirement and force the command to 
execute. 


The device information shows the leaf node name, the size, the amount of free available space, 
the partitioning format (such as MSDOS or GPT), the shared state (whether it is marked as 
Shareable for Clustering), and the RAID state (whether the device is an NSS software RAID 
device). Do not use an NSS software RAID for the device. 


For example, uninitialized devices report a format of None and a shared state of No: 


sdc size=102.00MB free=O0KB format=None shared=No RAID=No 
sdd size=102.00MB free=0KB format=None shared=No RAID=No 
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7 Initialize and share the two devices. At the command prompt, enter 


nlvm -s init <device_namel>,<device_name2> format=msdos shared 


WARNING: Initializing a device destroys all data on the device. 


Replace device_name1 and device_name2 with the leaf node names (such as sdc and sda) of 
the two SAN devices you want to use for the mirrored SBD partition. 


Specify a partitioning format of msdos. 
Specify the shared option to mark the devices as Shareable for Clustering. 


Use the -s NLVM option to override the shared locking requirement and force the command to 
execute. 


For example, to initialize devices sdc and sda, enter 

nlvm -s init sdc,sdd format=msdos shared 

You can list the devices to visually verify that the device is formatted and shared: 
nlvm -s list devices 


For example, the formatted devices sdc and sdd report a format of MsDos and a shared state of 
Yes: 


sdc size=102.00MB free=101.98MB format=MSDOS shared=Yes RAID=No 
sdd size=102.00MB free=101.98MB format=MSDOS shared=Yes RAID=No 


Create a mirrored SBD partition. At the command prompt, enter 
sbdutil -c -n <cluster_ name> -d <device_namel> -d <device_name2> -s <size> 


Replace cluster_name with the name of the cluster, such as cluster1. This name must match 
the name of an existing cluster that has a Cluster object in eDirectory. The name is case 
sensitive. 


Replace device_name1 and device_name2 with the leaf node names (such as sdc and sdd) of 
the two SAN devices you want to use for the mirrored SBD partition. The cluster1.msbdo 
mirrored SBD partition is created on the first device option instance in the command. The 
cluster1.msbd1 mirrored SBD partition is created on the second device option instance in the 
command. 


For the -s option, replace size with the size (in MB) to use for each of the SBD RAID1 segments. 
Specify the size only once. Both devices should be the same size, but if they are not, the size of 
the RAID segments is determined by the size of the smaller device. Use one of the following 
methods for specifying the size of the SBD partition. For information about size requirements, 
see “Preparing a SAN Device for the SBD” on page 174. 


+ Specify a value: Replace size with the size (in MB) to use for the SBD partition. 


For example, the following command creates the cl1.sbd mirrored RAID device and the 
cll.msbd0 and cl1.msbd1 partitions. Each segments is up to 1020 MB in size, depending 
on where the last cylinder boundary lies. 


sbdutil -c -n cll -d CX4-LUNO00 -d CX4-LUNO01 -s 1020 


+ Specify -1: You can specify the size as -1 to use all free space on the device. This option 
allows Novell Cluster Services to use a whole disk/LUN (or LUNs) that you set aside for 
SBD. 
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For example, the following command uses devices sdc and sda to create the 
cluster1.sbd mirrored RAID device and the SBD mirrored partitions cluster1.msbdo and 
cluster1.msbd1. It uses all available free space on the smaller device as the segment size. 


sbdutil -c -n clusterl -d sdc -d sdd -s -1 


+ Use default size: If the -s option is not used, the default size is 8 MB. 


9 (Optional) You can use the sbdutil -f -s command to verify the path and name of the SBD 


10 


RAID device. 


You can also use NSSMU, the Storage plug-in to iManager, or the nlvm -s list partitions 
command to view the partitions used by the RAID device. 


Modify the Cluster object in eDirectory to enable its NCS: Shared Disk Flag attribute. 


This step is required only if the cluster has never had an SBD partition. However, it does no harm 
to verify that the NCS: Shared Disk Flag attribute is enabled. 


10a In a web browser, open iManager, then log in to the eDirectory tree that contains the cluster 
you want to manage. 


IMPORTANT: Log in as an administrator user who has sufficient rights in eDirectory to 
delete and modify eDirectory objects. 


10b Select Directory Administration, then select Modify Object. 


10c Browse to locate and select the Cluster object of the cluster you want to manage, then click 
OK. 


10d Under Valued Attributes, select the NCS: Shared Disk Flag, then click Edit. 


Modify Object: $ecluster.novell 


General 

Valued Attributes Unvalued Attributes 
GUID ACL 
modifiersName i Audit:File Link 
NCS:CRM Quorum Certificate Validity Interval 
NCS:CRM Quorum Timeout Cross Certificate Pair 
NCS:CRM Resource Priority DirXML-Associations 
NCS:Email Addresses Equivalent To Me 
NCS:Email Fitter Last Referenced Time 
NCS:GIPC Heartbeat masvAuthorizedRange 
NCS:GIPC Master Watchdog masv Default Range 
NCS:GIPC Max Retransmits < masvProposedLabel 
NCS:GIPC Slave Watchdog | NCS:CRM HMO Setting 
NCS:GIPC Tolerance | NCS:CRM Load Script 
NCS:Network Address NCS:CRM Load Timeout 
NCS:Port Number NCS:CRM Unload Script 
NCS:Revision NCS:CRM Unload Timeout 
NCS:Shared Disk Flag NCS:GIPC Contig 
Network Address NCS:Node Isolation Script 
Object Class Other GUID 
Revision rbsAssignedRoles 
Used By ~y rbsAssignedRoles2 a 
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10e Select (enable) the NCS: Shared Disk Flag check box, then click OK. 


Edit Attribute 


NCS:Shared Disk Flag 
v 


OK | Cancel | 


10f Click Apply to save changes. 
11 On each cluster node, start Novell Cluster Services: 
11a Log in to the cluster node as the root user, then open a terminal console. 


11b At the command prompt, enter 


renovell-nes start 


11c After you have restarted Novell Cluster Services on all nodes, continue with the next step. 


12 On each cluster node, join the cluster. At the command prompt, enter 


cluster join 


Removing a Segment from a Mirrored Cluster SBD Partition 


You can remove a segment from a mirrored cluster SBD partition and keep the remaining SBD 
partition. The software RAID definition remains, so if you delete the remaining partition later, you must 
delete the software RAID instead of simply deleting the partition as with a stand-alone SBD partition. 


IMPORTANT: You can use NLVM commands to completely unmirror the SBD RAID1 device, and 
keep the SBD partition. See “Unmirroring a Mirrored SBD Partition with NLVM” in the OES 11 SP3: 


NLVM Reference. 


You can specify which segment to keep when you use NSSMU to remove a segment from a software 
RAID 1 (mirror) device. 


1 Log in to any node as the root user, then launch a terminal console. 
2 At the command prompt, enter 
cluster maintenance on 


This causes all cluster servers to enter maintenance mode. 
3 Remove a segment from the SBD RAID1 device. 
3a Launch NSSMU: 


nssmu 


3b Inthe NSSMU Main Menu, select RAID Devices. 
3c Select the software RAID1 device for the cluster SBD that you want to manage. 
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3d Press Enter to show its member segments. 


Del=Remove Segment from RAID SC Prev Menu 


3e Select the member segment you want to delete, press Delete to remove the RAID segment, 
then press y (Yes) to confirm the removal. 


3f Press Esc to return to the Software RAIDs page. 


The RAID definition remains for the remaining segment of the mirrored SBD partition. The 
SBD RAID1 reports that it has one segment. 


Ins=Create Del=Delete F3=Expand FésRestripe ENTER=Segments = 8 = FB=More 


3g Press Esc twice to exit NSSMU. 
4 Atthe terminal console of one cluster server, enter 


cluster maintenance off 


This causes all cluster servers to return to normal mode. 
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9.18.7 Deleting a Non-Mirrored Cluster SBD Partition 


You might need to delete and re-create a Novell Cluster Services SBD partition if the SBD becomes 
corrupted or its device fails. Use the procedure in this section to delete the SBD partition, then create 
a new SBD partition as described in Section 9.18.3, “Creating a Non-Mirrored Cluster SBD Partition 
with SBDUTIL,” on page 176 or Section 9.18.5, “Creating a Mirrored Cluster SBD Partition with 
SBDUTIL,” on page 183. 


IMPORTANT: You must take the cluster down and stop Novell Cluster Services on all nodes before 
you delete the existing SBD partition. Do not restart Novell Cluster Services and rejoin nodes to the 
cluster until after you create a new SBD. 


1 Ensure that nobody else is changing any storage on any nodes at this time. 


Until the SBD exists and the cluster is set up for shared disk access, you are responsible for 
ensuring that you have exclusive access to the shared storage. 


2 Take the cluster down: 
2a Log into any node in the cluster as the root user, then open a terminal console. 


2b At the command prompt, enter 
cluster down 


3 On each cluster node, stop Novell Cluster Services: 
3a Log in to the cluster node as the root user, then open a terminal console. 
3b At the command prompt, enter 


renovell-ncs stop 


3c After you have stopped Novell Cluster Services on all nodes, continue with the next step. 
4 Delete the SBD partition. 

4a Log in to any node in the cluster as the root user, then launch a terminal console. 

4b Launch NSSMU: 


nssmu 


4c Inthe NSSMU Main Menu, select Partitions. 
4d Select the SBD partition you want to delete, such as clus1.sbd. 
4e Press Delete to delete the partition, then press y (Yes) to confirm the deletion. 
4f Press Esc twice to exit NSSMU. 
5 Use one of the following methods to create a new SBD partition: 


¢ Section 9.18.3, “Creating a Non-Mirrored Cluster SBD Partition with SBDUTIL,” on 
page 176 


+ Section 9.18.5, “Creating a Mirrored Cluster SBD Partition with SBDUTIL,” on page 183 


Do not restart Novell Cluster services and rejoin nodes to the cluster until after you create the 
new SBD. 
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9.18.8 Deleting a Mirrored Cluster SBD 


You might need to delete and re-create a Novell Cluster Services SBD partition if the SBD becomes 
corrupted or its device fails. Use the procedure in this section to delete a mirrored SBD partition, then 
create anew SBD partition as described in Section 9.18.3, “Creating a Non-Mirrored Cluster SBD 
Partition with SBDUTIL,” on page 176 or Section 9.18.5, “Creating a Mirrored Cluster SBD Partition 
with SBDUTIL,” on page 183. 


IMPORTANT: You must take the cluster down and stop Novell Cluster Services on all nodes before 
you delete the existing mirrored SBD RAID1 device and its mirrored SBD partitions. Do not restart 
Novell Cluster Services and rejoin nodes to the cluster until after you create a new SBD. 


1 Ensure that nobody else is changing any storage on any nodes at this time. 


Until the SBD exists and the cluster is set up for shared disk access, you are responsible for 
ensuring that you have exclusive access to the shared storage. 


2 Take the cluster down: 
2a Log into any node in the cluster as the root user, then open a terminal console. 


2b At the command prompt, enter 
cluster down 


3 On each cluster node, stop Novell Cluster Services: 
3a Log in to the cluster node as the root user, then open a terminal console. 


3b At the command prompt, enter 
rcenovell-ncs stop 


3c After you have stopped Novell Cluster Services on all nodes, continue with the next step. 
4 Delete the mirrored software RAID that you used for the SBD partition: 

4a Log in to any node in the cluster as the root user, then launch a terminal console. 

4b Launch NSSMU: 


nssmu 


4c Inthe NSSMU Main Menu, select RAID Devices. 
4d Select the software RAID1 for the mirrored SBD you want to delete. 


4e Press Delete to delete the software RAID1 and its two mirrored SBD partitions, then press y 
(Yes) to confirm the deletion. 


4f Press Esc twice to exit NSSMU. 
5 Use one of the following methods to create a new SBD partition: 


¢ Section 9.18.3, “Creating a Non-Mirrored Cluster SBD Partition with SBDUTIL,” on 
page 176 


¢ Section 9.18.5, “Creating a Mirrored Cluster SBD Partition with SBDUTIL,” on page 183 


Do not restart Novell Cluster services and rejoin nodes to the cluster until after you create the 
new SBD. 
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9.18.9 Additional Information about SBD Partitions 


9,19 


See the following resources for additional information about SBD partitions: 


¢ To understand general requirements for SBD partitions, see Section 4.8.2, “SBD Partitions,” on 
page 65. 

¢ To configure the SBD when you configure the cluster on the first node, see Section 5.5.5, 
“Configuring a New Cluster,” on page 83. 


+ To use Novell Linux Volume Manager (NLVM) commands to create an SBD partition in a cluster, 
see “Creating or Mirroring an SBD Partition” in the OES 11 SP3: NLVM Reference. 


+ To use NLVM commands to delete an SBD partition in a cluster, see “Deleting an SBD Partition 
with NLVM” in the OES 11 SP3: NLVM Reference. 


¢ For information about how the split brain detector works, see NetWare Cluster Services: The 
Gory Details of Heartbeats, Split Brains, and Poison Pills (TID 10053882) (http:// 
support.novell.com/docs/Tids/Solutions/10053882.html). 


Customizing Cluster Services Management 


Some portions of Novell Cluster Services management can be performed and custom by using virtual 
XML files that exist in the /admin/Novell/Cluster directory on Linux. 


The cluster-related virtual XML files (management access points) are created on each server's / 
admin/Novell/Cluster directory. These files let you manage the cluster from any node in the 
cluster. This means that as long as the cluster is running, you can always access the cluster-related 
XML virtual files in the /admin/Novell/Cluster directory. 


There are two types of virtual files in the /admin/Novell/Cluster directory: XML files and CMD 
files. The XML files are read-only and contain cluster configuration or cluster state information. The 
CMD files are write-then-read command files that are used to issue commands to the cluster and 
retrieve resulting status. 


Table 9-3 lists the cluster-related virtual XML files and gives a brief description of each. 


Table 9-3 Cluster-Related Virtual XML Files 


Virtual XML File Name Description 


Config.xml Provides the combined information from ClusterConfig.xml, NodeConfig.xml, 
ResourceConfig.xml, and PoolConfig.xml. 


ClusterConfig.xml Provides cluster configuration information. 


NodeConfig.xml Provides node configuration information for all nodes in the cluster that were 
active at the time the cluster was brought up. 


NodeState.xml Provides current information on the state of each node in the cluster (cluster 
membership). 


PoolConfig.xml Provides cluster-enabled pool and volume configuration information for each 
pool and volume. 


PoolState.xml Provides current information on the state of each cluster-enabled pool in the 
cluster. 
ResourceConfig.xml Provides resource configuration information for each resource in the cluster. 
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Virtual XML File Name Description 


ResourceState.xml Provides current information on the state of each resource in the cluster. 


State.xml Provides the combined information from NodeState.xml, ResourceState.xml, 
and PoolState.xml. 


Table 9-4 lists the cluster-related CMD files and gives a brief description of each. 


Table 9-4 Cluster-Related CMD Files 


CMD File Name Description 


Node.cmd Write-then-read command file used in conjunction with a Perl script to issue 
node-specific commands to the cluster and retrieve resulting node status and 
configuration information. 


Cluster.cmd Write-then-read command file used in conjunction with a Perl script to issue 
cluster-specific commands to the cluster and retrieve resulting cluster status and 
configuration information. 


Resource. cmd Write-then-read command file used in conjunction with a Perl script to issue 
resource-specific commands to the cluster and retrieve resulting resource status 
and configuration information. 
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Configuring and Managing Cluster 
Resources 


After you create and configure a Novell Cluster Services cluster, you are ready to create and 
configure cluster resources for the cluster. This section provides general instructions for creating 
cluster resources and configuring their behavior in the cluster. 


For information about viewing and managing resource status on the cluster, see Chapter 9, 
“ Managing Clusters,” on page 151. 

¢ Section 10.1, “Planning for Cluster Resources,” on page 193 

¢ Section 10.2, “Setting Up a Personalized List of Resources to Manage,” on page 195 

¢ Section 10.3, “Using Cluster Resource Templates,” on page 200 

¢ Section 10.4, “Creating Cluster Resources,” on page 205 

¢ Section 10.5, “Configuring a Load Script for a Cluster Resource,” on page 206 

¢ Section 10.6, “Configuring an Unload Script for a Cluster Resource,” on page 207 

¢ Section 10.7, “Enabling Monitoring and Configuring the Monitor Script,” on page 208 


¢ Section 10.8, “Applying Updated Resource Scripts by Offline/Offline, Failover, and Migration,” on 
page 213 


¢ Section 10.9, “Configuring the Start, Failover, and Failback Modes for Cluster Resources,” on 
page 214 


¢ Section 10.10, “Configuring Preferred Nodes and Node Failover Order for a Resource,” on 
page 216 


¢ Section 10.11, “Configuring Resource Priorities for Load Order,” on page 218 
¢ Section 10.12, “Configuring Resource Mutual Exclusion Groups,” on page 219 
¢ Section 10.13, “Controlling Resource Monitoring,” on page 224 

¢ Section 10.14, “Changing the IP Address of a Cluster Resource,” on page 224 
¢ Section 10.15, “Renaming a Cluster Resource,” on page 227 


¢ Section 10.16, “Deleting Cluster Resources, or Disabling Clustering for a Pool, LVM Volume 
Group, or Service,” on page 228 


¢ Section 10.17, “Additional Information for Creating Cluster Resources,” on page 231 


10.1 Planning for Cluster Resources 


Consider the guidelines in this section when planning for your cluster resources. 


¢ Section 10.1.1, “Naming Conventions for Cluster Resources,” on page 194 

¢ Section 10.1.2, “Using Parameter Values with Spaces in a Cluster Script,” on page 194 
¢ Section 10.1.3, “Using Double Quotation Marks in a Cluster Script,” on page 194 

¢ Section 10.1.4, “Script Length Limits,” on page 195 


¢ Section 10.1.5, “Planning Cluster Maintenance,” on page 195 
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10.1.1 


10.1.2 


10.1.3 


¢ Section 10.1.6, “Number of Resources,” on page 195 
¢ Section 10.1.7, “Linux POSIX File System Types,” on page 195 


Naming Conventions for Cluster Resources 


Cluster resource names can be up to 63 characters. Novell Cluster Services supports only 
alphanumeric characters and the underscore character in cluster resource names: 


ABCDEFGHIJKLMNOPQRSTUVWXYZabcdefghijklmnopgqrstuvwxyz0123456789__ 
Special characters, such as the following, are not supported in cluster resource names: 
!@#S%& () 


Because the NSS pool name and Linux volume names are automatically used in the cluster resource 
name, do not use special characters !@#$%&() in names of NSS pools or Linux POSIX volumes that 
you plan to cluster enable. 


Using Parameter Values with Spaces in a Cluster Script 


In cluster scripts, if a parameter value contains spaces, you should enclose the value with both 
double-quotes (") and single-quotes ('). For example, "'quoted text'". The preferred solution is to 
use both sets of quotation marks with the single-quotes on the inside. For OES 11 and later, the other 
order also works for spaces, but it reads a variable as text, not as a variable. 


For example, either of the following techniques works for values with spaces: 
exit_on_error echo "'Errors will be reported here.'" 
exit_on_error echo '"Errors will be reported here."' 


You can alternatively use two sets of double-quotes and escape the inside set of double-quotes with 
a backslash (\). For example: 


exit _on_error echo "\"Errors will be reported here.\"" 
Another alternative is to escape each of the spaces in the value. For example: 


exit_on_error echo Errors\ will\ be\ reported\ here. 


Using Double Quotation Marks in a Cluster Script 


In cluster scripts, if a command requires double-quotation marks, you should enclose the quoted part 
of the command with both double-quotes (") and single-quotes ('), such as "'quoted text'". The 
key is to use both sets of quotation marks with the single-quotes on the inside. This works for spaces 
and allows you to pass variables to the command. For example: 


exit_on_error echo "'Errors will be reported here.'" 


You can alternatively use two sets of double-quotes and escape the inside set of double-quotes with 
a backslash (\). For example: 


exit _on_error echo "\"Errors will be reported here.\"" 
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10.1.4 


10.1.5 


10.1.6 


10.1.7 


10.2 


Script Length Limits 


Each cluster load, unload, or monitor script can be up to 3200 bytes in length. This limit includes 
commands, comments, and spaces. For example, non-special ASCII characters (including the space 
character) are 1 byte per character, so you could have up to 3200 of these characters in a script. 


IMPORTANT: Creating a script that exceeds the maximum script length can prevent a resource from 
loading. If your script commands and comments require more memory than 3200 bytes, you can 
spawn external scripts from a script. 


Planning Cluster Maintenance 


When performing cluster maintenance tasks, two cluster best practices should be observed: 


+ Perform maintenance tasks during non-peak hours so that users are minimally affected. 


+ Before performing maintenance on a node, cluster migrate its cluster resources to another node 
if you want the related users to be undisturbed. 


Number of Resources 


Novell Cluster Services supports up to 254 resources in a cluster, regardless of the size of the cluster. 


Linux POSIX File System Types 


Ext3 is the default file system type used in the Generic File System template scripts. The Btrfs, Ext2, 
Ext3, ReiserFS, and XFS file systems have been tested and are fully supported. 


Setting Up a Personalized List of Resources to 
Manage 


The My Resources page in the Clusters plug-in for iManager allows each cluster administrator to set 
up a personalized list of cluster resources to manage. This allows an administrator to view at a glance 
the status of the specified resources. The list persists between the administrator’s logins to the same 
iManager server. 


Your personalized list of cluster resources and display preferences are saved on the iManager server 
in the following location: 


/var/opt/novell/iManager/nps/WEB-INF/config/NDS<tree_name>- 
<user name_and_context_without_dots>/ncs.xml 


For example, for tree AVALONTREE and user admin.nove1l, the file path is: 
/var/opt /novell/iManager/nps/WEB-INF/config/NDSAVALONTREE-adminnovell/ncs.xml 
The following sections describe how manage the list of resources and to personalize the display. 


¢ Section 10.2.1, “Adding Resources to a My Resources List,” on page 196 
¢ Section 10.2.2, “Viewing Information about Resources in a My Resources List,” on page 196 
¢ Section 10.2.3, “Personalizing the My Resources Display,” on page 198 
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¢ Section 10.2.4, “Removing Resources from a My Resources List,” on page 199 


¢ Section 10.2.5, “Updating the My Resources List after Renaming or Deleting a Resource,” on 
page 200 


10.2.1 Adding Resources to a My Resources List 


1 Log in to iManager as a cluster administrator. 
2 In Roles and Tasks, select Clusters > My Resources. 


The list is initially empty. 


K Roles and Tasks 


My Resources 2 


The list below provides a convenient way to keep track of resources you frequently manage. Click on the add button to browse for resources in 
the tree, and select them to be added to the list 


Add Remove Refresh 


E] Status Name Cluster Lives Up Since BCC 


[All Categories] zÍ 


The list is empty. Click the Add button to browse for and select one or more resources 


Nirectary Adminictratian 


3 Click Add to open the eDirectory browser pop-up window. 


4 Browse the tree where you are currently logged in to locate and select one or more Cluster 
Resource objects, then click OK. 


Newly selected resources are added to your personalized list. 


(© Roles and Tasks 


- ? 
[All Categories] x My he ë 
RSPR TAN ea aE A a a The list below provides a convenient way to keep track of resources you frequently manage. Click on the add button to browse for 
Archive Versioning F resources in the tree, and select them to be added to the list. 
Clusters 
My Clusters 
Add Remove Refresh 
My Resources 
Status Name « Cluster Lives Up Since BCC 
E @ Master IP Address Reso... $e clustert 2 2012-08-30 17:37 
sees EJ E] 4 Master IP Address Reso... > Cluster2 1 2012-08-30 10:37 
Distributed File Services _ 
aa S AE ae O @ f@ P11 SERVER cluster1 4 2012-08-30 17:37 Y 
DNS 
Ta oUat sstwetvsvetedstvecsaxteese Westauvecsevaresuuestesthestavasend F] m) @ P11 SERVER cs cluster2 Y 
eDirectory Encryption = 
a aes een A E =) Ea P12 SERVER cluster2 yY 
eDirectory Maintenance — 
File Access (NetStorage) 
E @ P13 SERVER } custer2 1 2012-09-06 14:56 Y 
=)  @ P13 SERVER $> duster ai 
© @ 4 va15 resource $e clus10 14 2012-08-15 09:20 
O @ @ vate resource  clus10 2 2012-08-22 13:02 


5 (Optional) Personalize the display as described in Section 10.2.3, “Personalizing the My 
Resources Display,” on page 198. 


10.2.2 Viewing Information about Resources in a My Resources 
List 


1 Log in to iManager as a cluster administrator. 


2 In Roles and Tasks, select Clusters > My Resources. 
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The My Resources page displays your personalized list of cluster resources in the tree. 


| A] Roles and Tasks 


? 
TE My Resources —“—*i—s—s—s—sS 
AR As LR fn The list below provides a convenient way to keep track of resources you frequently manage. Click on the add button to browse for 


Archive Versioning resources in the tree, and select them to be added to the list. 


Clusters 
My Clusters 


Add Remove Refresh 
My Resources 


: l Status Name « Cluster Lives Up Since BCC 
DHCP (OES Linux) 
SAT eae @ Master IP Address Reso... $ clustert 2 2012-08-30 17:37 
Directory Administration 
setecssstecsnsteceensncennsecenntecennscneenes E @ Master IP Address Reso... $e cluster2 4 2012-08-30 10:37 
Distributed File Services = 
stssnessnesnenenenenenensnensnvnsnnnssvensnest) ge © @ P11 SERVER cluster1 1 2012-08-30 17:37 Y 
DNS 
Perron tir rent ace eee F] m) e P11 SERVER $ custer2 Y 
eDirectory Encryption 
SA EOE E eA AAE E O ON A EE / = ~ e P12 SERVER Ps cluster2 yY 
eDirectory Maintenance 
E ES Œ © P12 SERVER $> custert 1 2012-08-30 15:57 Y 
File Access (NetStorage) 
Sys sais Ne A a ad fac a CE @ P13 SERVER  custer2 1 2012-09-06 14:56 Y 
File Protocols 
n R anaes EAEE A AAA o © G P13 SERVER ge duster Y 
Files and Folders 
T g15 clus10 -08- 2 

Coes @ 4 va15 resource  clus10 4 2012-08-15 09:20 
Help Desk OH @ æ vns resource  clus10 2 2012-08-22 13:02 


3 View the Status icon next to a Cluster Resource object to understand the current state of the 
resource. 


If scrolling is needed to view the complete list, you can use the Refresh option to set a longer 
refresh rate for the page in order to allow enough time to view the status for all items. 


State Icon Description 

Normal © The resource is online. 

Offline m The resource is offline. Administrator intervention is needed. 

Critical x The resource is comatose, or it cannot be found (renamed or deleted). 


Administrator intervention is needed. 


If you rename or delete a resource, its status changes to "Resource not 
found" when you next access or refresh the My Resources page. For a 
deleted resource, remove the resource from the list. For a renamed 
resource, remove the resource from the list, then add the resource using its 


new name. 

Warning > An alert condition has occurred, and the resource needs administrator 
attention. 

Unknown >) The state of the cluster resource cannot be determined. 
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10.2.3 


198 


4 The My Resources list displays the following information about each resource: 


Parameter 


Name 


Description 


The name assigned to the resource. 


Distinguished Name 


(Not displayed by default) The dot-delimited fully distinguished name of the 


resource, such aS resourcename.clustername. context .domain. 


Cluster The name of cluster for the resource. 

Lives The number of times the resource has been brought online. 

Up Since The date and time the resource was brought online. 

BCC A check mark in this column indicates that the resource is enabled for a 


Business Continuity Cluster (BCC). 


5 (Optional) Personalize the display as described in Section 10.2.3, “Personalizing the My 
Resources Display,” on page 198. 


Personalizing the My Resources Display 


The My Resources page provides menus in the column headings that allow you to personalize the 
display. You can sort the entries, modify the columns, or filter the entries. Your preferences are saved 


between logins to iManager. 


1 Log in to iManager as a cluster administrator. 


2 In Roles and Tasks, select Clusters > My Resources. 


3 Select Refresh, then choose a refresh rate that is long enough to allow you to view all items in 


the list. 


4 Click or mouse-over a column heading to activate its options, then click the arrow to access the 


menu for that column. 


5 Perform one of the available actions when you access the column’s menu. Some actions are not 


available for all fields. 


¢ Sort: Select Sort Ascending (A to Z) or Sort Descending (Z to A) to specify the preferred 
sort order. Resource objects are sorted based on values in the selected column. Numbers 
are treated as text values and are sorted alphabetically, not numerically. 


My Resources 


The list below provides a conver 


sources in the tree, and sect them to be a 


Add Remove 


("| Status Name « 
E pilaster iP Address Reso.. $ cluster 
E @® pilaster iP Address Reso.. $e cluster2 | 
E @ gern server 


E © get SERVER 


Cluster >] Lives Up Since Bec 
9] Sort ascending 0 17:37 
zi Sort Descending 0 10:37 
`) Columns 
$> custeri © 17:37 ¥ 
Fitters 
ĝe custer2 Y 
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+ Columns: Select Columns to display the parameters, select or deselect a parameter’s 
check box to add or remove the column, then press Enter to apply the changes. The 
parameters are described in Step 4 in Section 10.2.2, “Viewing Information about 
Resources in a My Resources List,” on page 196. 


My Resources 2] 
The list below provides a convenient way to keep track of resources you frequently manage. Click oa the add button to browse for 
resources in the tree, and seect them to be adoed to the list. 


Add Remove Refresh 


F| Status Namea Cluster Lives Up Since Bcc 
| @ hasier IP Agcress Reso. $e clustert $| sort ascending 0 17:37 
| @  geMaster IP Address Reso.. $e ciretorr ál S10 10:37 
fal stews LS) Columns 
E @® Pi SERVER cl] o 17:37 A 
[J] Name = Fitters 
i e Fred P11 SERVER $ C| = Distinguished Name v 
| © @ P12 SERVER ĝo c| E coer v 
/ Lives 
E ® @ P12 SERVER ÈP S| up since 1  2012-08-301557 y 
E @ P12 SERVER c| F scc 1 2012-09-06 14:56 d 
¢ Filter: Specify a filter to display only the Cluster objects with values that match. 
My Resources ? 
The list below provides a convenient way to keep track of resources you frequently manage. Click on the add button to browse for 


resources in the tree, and seect them to be adced to the list. 


My Resources 


Add Remove Refresh 


[E] Status Name + Cluster Bcc 
E @ plaster IP Address Reso. $e» clustert | Sort ascending 17:37 
Fl @ 4 Master IP Address Reso.. $> cluster? -a “Je v0:37 

E] Columns 
E@ P11 SERVER oa 17:37 Y 
= Enter fitter text. 
E © f PN SERVER $e d v 


To add or modify a column’s filter, select Filter, place the cursor in the Filter field, type the 
desired filter text, then press Enter to apply the filter. If a cluster’s parameter value matches 


the specified filter, the Cluster Resource object and its information are displayed. 


To remove a column’s filter, select Filter, place the cursor in the Filter field, delete the filter 


text, then press Enter to refresh the display. The filter no longer applies for that column. 


10.2.4 Removing Resources from a My Resources List 


1 Log in to iManager as a cluster administrator. 


2 In Roles and Tasks, select Clusters > My Resources. 


3 Select the check box next to the resource that you want to remove from your personalized list, 


then click Remove. 


The resource is removed from your personalized list. This action does not delete the Cluster 


Resource object or its data. 
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10.2.5 


10.3 


10.3.1 


Updating the My Resources List after Renaming or Deleting 
a Resource 


In a My Resources list, if you rename or delete a resource, its status changes to Critical: 
Resource not found. You must manually update the resource list. 


To update the list after deleting a resource: 


1 In iManager, go to Clusters > My Resources. 
2 In the My Resources list, select the check box next to the resource entry for the deleted 
resource, then click Remove. 


To update the list after renaming a resource: 


1 In iManager, go to Clusters > My Resources. 
2 In the My Resources list, select the check box next to the resource entry, then click Remove. 


3 Click Add, select the newly named resource, then click OK. 


Using Cluster Resource Templates 


Templates simplify the process of creating similar or identical cluster resources. For example, 
templates are helpful when you want to create multiple instances of the same resource on different 
servers. Several templates are provided for you. You can also create templates for any server 
application or resource you want to add to your cluster. 


¢ Section 10.3.1, “Default Resource Templates,” on page 200 
¢ Section 10.3.2, “Viewing or Modifying a Resource Template in iManager,” on page 201 
¢ Section 10.3.3, “Creating a Resource Template,” on page 203 


¢ Section 10.3.4, “Synchronizing Locally Modified Resource Templates with Templates in 
eDirectory,” on page 205 


Default Resource Templates 


Novell Cluster Services provides several cluster resource templates that you can use on physical 
servers, virtualization host servers, and virtual machine (VM) guest servers (DomU). You can also 
create your own templates or personalize the default templates by using the Clusters plug-in for 
iManager. See Section 10.3.3, “Creating a Resource Template,” on page 203. Third-party templates 
might also available for third-party applications; see the vendor documentation. 


Table 10-1 identifies the cluster resource templates that can be used for OES services and storage on 
physical servers and virtual machine guest servers: 


Table 10-1 Cluster Resource Templates for Physical Servers and VM Guest Servers 


Cluster Resource Template OES 11 and Later Product 
AV Novell Archive and Version Services 
DHCP Novell Dynamic Host Configuration Protocol using an NSS pool 


Novell Dynamic Host Configuration Protocol using a Linux POSIX File 
System 
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10.3.2 


Cluster Resource Template 


DNS 


OES 11 and Later Product 


Novell Domain Name System 


Generic File System (Generic_FS) 


LVM volume groups 


Generic IP Service 


This template can be modified to create cluster resources for certain 
server applications that run on your cluster. 


iFolder Novell iFolder 3.9 
The template scripts contain examples for NSS pools and LVM volume 
groups. 

iPrint Novell iPrint 

MySQL MySQL 5.0x for Linux 

Samba Novell Samba 


Third-party templates 


See your vendor documentation. 


Novell Cluster Services provides the following templates for use by the Xen VM host server (Dom0). 
They are the only two templates supported for use in the virtualization host server environment. They 
are not supported for use by a VM guest server. The templates are generic and can be modified to 
start or stop different virtualization host server software. 


Table 10-2 Cluster Resource Templates for Virtualization Host Environments 


Cluster Resource Template 


Use 


Xen Use to configure the cluster resource for a virtual machine. 
This template is available only on a virtualization host server. See 
Section 15.2.1, “Creating a Xen Virtual Machine Cluster Resource,” on 
page 423. 

XenLive Use to configure the cluster resource for a virtual machine. It provides 


an additional function to allow a virtual machine resource migration 
(manual) without the need to boot or bring up the virtual machine on the 
cluster node where the virtual machine has been migrated. 


This template is available only on a virtualization host server. See 
Section 15.2.3, “Setting Up Live Migration,” on page 431. 


Viewing or Modifying a Resource Template in iManager 


You can view or manage the Novell Cluster Services resource templates from the Cluster Options 
page in the Clusters plug-in for iManager. Ensure that you use the Clusters plug-in to modify the 
properties of the resource template. The modified settings apply for all subsequent cluster resources 


that you create from the template. 


1 In iManager, select Clusters > My Clusters. 


2 Select the cluster that you want to manage. 


If the cluster does not appear in your list, add the cluster to your list as described in Section 8.2, 
“Setting Up a Personalized List of Clusters to Manage,” on page 117. 
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3 Select the Cluster Options tab to access the templates. 


è clus1.ncs.novell 2] 


View cluster resource configuration information and administer cluster resources for the selected cluster 


Cluster Manager \ BCC Manager \ Cluster Event Log f Cluster Options | Options 


_ Properties... | 

Cluster Objects 

New | Delete | Details 13 Item(s) 
Type Ẹ| Name IP Address Distinguished Name Pool Name 

Master IP Address Resource 10.10.10.134 cn=clus1.ou=ncs,o=novell 


avalon 10.10.10.37 — cn=avalon,cn=clus1,ou=ncs,o=novell 


AV _ Emplate 

DHCP Emplate 

DNS Emplate 
Generic FS mplate 
Generic IP_ Service 
iFolder_TEmplate 
iPrint_Emplate 
MySQL Emplate 
Samba _Emplate 
Xen _Emplate 


0/0/0/0/0/0/0/0/0/0/0/0/0/0 


>| 2| a] we] | a] 2| | 2| 2| | V| & 


XenLive Emplate 


4 Click the template name to view or modify the properties for the template. 
For example, the following image shows the Properties page for the Generic File System 
template: 


"= Generic_FS_Template [2] 


f Policies Y Monitoring \ Preferred Nodes \ Scripts \ Business Continuity \ 


Set Start, Failover and Failback modes for the new resource. Changes other than business continuity changes made to a resource will not take affect until the 
resource is reloaded 


Failover Mode 
Resource Follows Master @ Auto 
[C] Ignore Quorum O Manual 
Start Mode Failback Mode 
@ Auto O Auto 
O Manual @ Disable 
O Manual 
OK | Cancel | Apply | 


5 Click the tabs to view or modify the default property settings for the resource template. 
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The process for modifying a resource template is similar to modifying the settings for a cluster 
resource. If you modify a setting on the page, click Apply before you click the next tab in order to 
save the changes. 


+ Policies 


Use the Policies tab to view or modify the default policies to use for the resource template. 
See Section 10.9, “Configuring the Start, Failover, and Failback Modes for Cluster 
Resources,” on page 214. 


+ Monitoring 


Use the Monitoring tab to enable or disable monitoring. If monitoring is enabled, you can 
set the default behaviors for monitoring, including the interval to poll the resource’s health, 
and the action to take if the resource fails to load on the maximum number of local restarts. 
See Section 10.7, “Enabling Monitoring and Configuring the Monitor Script,” on page 208. 


+ Preferred Nodes 


Use the Preferred Nodes tab to view or modify the preferred nodes to use for cluster 
resources that are created with the selected template. See Section 10.10, “Configuring 
Preferred Nodes and Node Failover Order for a Resource,” on page 216. 


¢ Scripts 


Use the Scripts tab to view or modify the default load, unload, and monitor scripts for the 
selected template. See the following: 


¢ Section 10.5, “Configuring a Load Script for a Cluster Resource,” on page 206 
¢ Section 10.6, “Configuring an Unload Script for a Cluster Resource,” on page 207 
¢ Section 10.7.4, “Example Monitor Scripts,” on page 213 

¢ Business Continuity 


The Business Continuity tab contains information only if the selected cluster is enabled for 
Novell Business Continuity Clustering. If the page is enabled, you can view or set the 
default settings for resources created from the template. See the Novell Business Continuity 
Clustering documentation website (http://www.novell.com/documentation/bcc). 


6 Click OK 


Creating a Resource Template 


Templates help ensure that all of the necessary definition information, dependent services to be 
loaded, unloaded, or monitored, and the shared service or storage are entered correctly. You can use 
the default templates as a guide for what types of information to include in your personalized 
template, as well as the sequence of commands for loading, unloading, or monitoring a resource. 

1 In iManager, select Clusters > My Clusters. 

2 Select the cluster that you want to manage. 


If the cluster does not appear in your list, add the cluster to your list as described in Section 8.2, 
“Setting Up a Personalized List of Clusters to Manage,” on page 117. 


3 Select the Cluster Options tab to access the templates. 
4 Click the New link. 


5 Specify Template as the resource type you want to create by clicking the Template radio button, 
then click Next. 
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New Resource 
Resource Type Select the type of cluster resource to create. 


a Pool 
@® Resource 


e i Template 


6 In Cluster Resource Name, specify the name of the template you want to create. 


7 If desired, in Inherit from Template, browse to the Cluster object and select the existing resource 
template in the Cluster container that you want to personalize for the new template. 


8 Ensure that the Define Additional Properties check box is selected, then click Next to continue 
to the Load Script page. 


9 On the Load Script page, configure the load script for the cluster resource template. 


9a Edit or add variables with example values for your template configuration, such as the 
mount point, IP address, volume group name, file system type, and mount device. 


9b Edit or add any lines to the load script that are required to load dependent services such as 
web servers or file access protocols. 


9c Edit or add the necessary commands to the script to load the resource on the server. 


For example, this might include bind command for the NCP service and the mount 
commands for the shared disks and file systems. 


9d Specify the default Load Script Timeout value, then click Next to continue to the Unload 
Script page. 


The timeout value determines how much time the script is given to complete. If the script 
does not complete within the specified time, the resource becomes comatose. Cluster 
Services marks the process as failed right after the defined timeout expires, but it must wait 
for the process to conclude before it can start other resource operations. 


10 On the Unload Script page, configure the unload script for the cluster resource template. 


10a Edit or add variables with example values for your template configuration, such as the 
mount point, IP address, volume group name, file system type, and mount device. 


10b Edit or add the necessary commands to the script to unload the resource from the server. 


For example, this might include unbind command for the NCP service and the dismount 
commands for the shared disks and file systems. 


10c Edit or add any lines to the unload script that are required to unload the dependent services 
that are loaded by this cluster resource. 


10d Specify the default Unload Script Timeout value, then click Next to continue to the Monitor 
Script page. 


The timeout value determines how much time the script is given to complete. If the script 
does not complete within the specified time, the resource becomes comatose when 
migrating to another node. Cluster Services marks the process as failed right after the 
defined timeout expires, but it must wait for the process to conclude before it can start other 
resource operations. 


11 On the Monitor Script page, configure the monitor script for the cluster resource template. 


11a Edit or add the variables with example values for your template configuration, such as the 
mount point, IP address, volume group name, file system type, and mount device. 


11b Edit or add the necessary commands to the script to monitor the resource on the server. 


You can use the same commands that are used at the Linux terminal console. 
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10.4 


The resource templates included with Novell Cluster Services for Linux include resource 
monitor scripts that you can customize. 


11c Specify the default Monitor Script Timeout value, then click Next. 


The timeout value determines how much time the script is given to complete. If the script 
does not complete within the specified time, the failure action the administrator chooses for 
monitoring (comatose, migrate, or reboot) initiates. Cluster Services marks the process as 
failed right after the defined timeout expires, but it must wait for the process to conclude 
before it can start other resource operations. 


12 On the Resource Policies page, specify the default Start, Failover, and Failback modes, then 
click Next. 


13 On the Resource Preferred Nodes page, specify the node assignments for the resource 
template, then click Finish. 


The template you created is saved to the Cluster container of the cluster you selected. If you 
personalized an existing template, both the old template and the new template are in the 
container. 


Synchronizing Locally Modified Resource Templates with 
Templates in eDirectory 


You can also view the resource templates outside of iManager. They are cached as /var/opt/ 
novell/ncs/* Template. * files on the master node of the cluster. Typically, you modify the 
templates by using the Clusters plug-in to iManager as described in Section 10.3.2, “Viewing or 
Modifying a Resource Template in iManager,” on page 201. However, if you add new template files or 
modify the files locally on the master cluster node, you must synchronize those changes with the 
resource templates and scripts that are held in the Cluster container in eDirectory. 


To synchronize the locally modified resource templates with those held in the Cluster container in 
eDirectory, 

1 Log in to the master node of the cluster as the root user, then open a terminal console. 

2 At the command prompt, enter the following commands: 


/opt/novell/ncs/bin/ncstemp1 . py 


/opt/novell/ncs/bin/nes-configd.py -init 


Creating Cluster Resources 


Cluster resources must be created for every shared file system or server that you run on servers in 
your cluster. Cluster resources can include websites, email servers, databases, and any other server- 
based applications or services you want to make available to users at all times. 

1 In iManager, select Clusters > My Clusters. 

2 Select the cluster that you want to manage. 


If the cluster does not appear in your list, add the cluster to your list as described in Section 8.2, 
“Setting Up a Personalized List of Clusters to Manage,” on page 117. 


3 Select the Cluster Options tab. 
4 On the Cluster Options page, click the New link. 


5 Specify Resource as the resource type you want to create by clicking the Resource radio button, 
then click Next. 
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6 Specify the name of the resource you want to create. 


NOTE: Do not use periods in cluster resource names. Novell clients interpret periods as 
delimiters. If you use a space in a cluster resource name, that space is converted to an 
underscore. 


7 Inthe Inherit From Template field, specify one of the available templates, such as the 
Generic_FS_Template. 


For information about cluster resource templates, see Section 10.3, “Using Cluster Resource 
Templates,” on page 200. 


8 Select the Define Additional Properties check box, then click Next. 


9 If you are creating a new cluster resource, continue with “Configuring a Load Script for a Cluster 
Resource” on page 206. 


10.5 Configuring a Load Script for a Cluster Resource 


A load script is required for each resource, service, disk, or pool in your cluster. The load script 
specifies the commands to start the resource or service on a server. 


Example load scripts are available in the following sections: 


¢ Section 12.6, “Configuring a Load Script for the Shared NSS Pool,” on page 260 


¢ Section 14.4.3, “Sample Load Script for a CSM Resource without a Segment Manager,” on 
page 405 


+ “Sample Generic LVM Resource Load Script” on page 365 
If you are creating a new cluster resource, the load script page should already be displayed. You can 
start with Step 6. 

1 In iManager, select Clusters > My Clusters. 

2 Select the cluster that you want to manage. 


If the cluster does not appear in your list, add the cluster to your list as described in Section 8.2, 
“Setting Up a Personalized List of Clusters to Manage,” on page 117. 


3 Select the Cluster Options tab. 
4 Select the cluster resource to view its Properties page. 
You can also select the check box next to the cluster resource, then click Details. 
5 On the Properties page, click the Scripts tab, then click the Load Script link. 
6 Edit or add the necessary commands to the script to load the resource on a server. 


You can then add any lines to the load script that are required to load needed services like web 
servers, and so on. 


You also need to personalize the script by replacing variables with actual values for your specific 
configuration, such as the mount point, IP address, volume group name, file system type, and 
mount device. 


IMPORTANT: Do not comment out commands that are automatically generated for parameters 
that define the cluster resource, such as the mount point, IP address, volume group name, file 
system type, and device. 


7 Specify the Load Script Timeout value, then click Apply to save the script or, if you are creating 
a new cluster resource, click Next. 
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The timeout value determines how much time the script is given to complete. If the script does 
not complete within the specified time, the resource becomes comatose. Cluster Services marks 
the process as failed right after the defined timeout expires, but it must wait for the process to 
conclude before it can start other resource operations. 


The timeout value is applied only when the resource is migrated to another node. It is not used 
during resource online/offline procedures. 


8 Do one of the following: 


+ If you are configuring a new resource, click Next, then continue with Section 10.6, 
“Configuring an Unload Script for a Cluster Resource,” on page 207. 


¢ Click Apply to save your changes. 


Changes for a resource’s properties are not applied while the resource is loaded or running 
on a server. Apply the updated script by taking the resource offline and then bringing it 
online on the same node. Alternatively, after the updated scripts have been synchronized 
from eDirectory to the source and destination nodes, the updated scripts are used 
automatically on system failover or cluster migration. For more information, see 

Section 10.8, “Applying Updated Resource Scripts by Offline/Offline, Failover, and 
Migration,” on page 213. 


Configuring an Unload Script for a Cluster 
Resource 


Depending on your cluster application or resource, you can add an unload script to specify how the 
application or resource should terminate. An unload script is not required by all resources, but is 
required for cluster-enabled Linux partitions. Consult your application vendor or documentation to 
determine if you should add commands to unload the resource. 


Programs should be unloaded in the reverse order of how they were loaded. This ensures that 
supporting programs are not unloaded before programs that rely on them in order to function 


properly. 
Example unload scripts are available in the following sections: 


¢ Section 12.7, “Configuring an Unload Script for the Shared NSS Pool,” on page 262 


¢ Section 14.4.4, “Sample Unload Script for CSM Resource without a Segment Manager,” on 
page 406 


¢ “Sample Generic LVM Resource Unload Script” on page 366 
If you are creating a new cluster resource, the unload script page should already be displayed. You 
can start with Step 6. 

1 In iManager, select Clusters > My Clusters. 

2 Select the cluster that you want to manage. 


If the cluster does not appear in your list, add the cluster to your list as described in Section 8.2, 
“Setting Up a Personalized List of Clusters to Manage,” on page 117. 


3 Select the Cluster Options tab. 
4 Select the cluster resource to view its Properties page. 
You can also select the check box next to the resource, then click Details. 
5 On the Properties page, click the Scripts tab, then click the Unload Script link. 


6 Edit or add the necessary commands to the script to unload the resource on the server. 
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You can add any lines to the unload script that are required to unload services that are loaded by 
this cluster resource. 


You also need to personalize the script by replacing variables with actual values for your specific 
configuration, such as the mount point, IP address, volume group name, file system type, and 
mount device. 


7 Specify the Unload Script Timeout value, then click Apply to save the script or, if you are 
creating a new cluster resource, click Next. 


The timeout value determines how much time the script is given to complete. If the script does 
not complete within the specified time, the resource becomes comatose when migrating to 
another node. Cluster Services marks the process as failed right after the defined timeout 
expires, but it must wait for the process to conclude before it can start other resource operations. 


The timeout value is applied only when the resource is migrated to another node. It is not used 
during resource online/offline procedures. 


8 Do one of the following: 


+ If you are configuring a new resource, click Next, then continue with Section 10.7.2, 
“Configuring Resource Monitoring,” on page 210. 


+ Click Apply to save your changes. 


Changes for a resource’s properties are not applied while the resource is loaded or running 
on a server. Apply the updated script by taking the resource offline and then bringing it 
online on the same node. Alternatively, after the updated scripts have been synchronized 
from eDirectory to the source and destination nodes, the updated scripts are used 
automatically on system failover or cluster migration. For more information, see 

Section 10.8, “Applying Updated Resource Scripts by Offline/Offline, Failover, and 
Migration,” on page 213. 


10.7 Enabling Monitoring and Configuring the Monitor 
Script 


Resource monitoring allows Novell Cluster Services to detect a the resource failure independently of 
its ability to detect node failures. Monitoring is disabled by default. It is enabled separately for each 
cluster resource. 

¢ Section 10.7.1, “Understanding Resource Monitoring,” on page 208 

¢ Section 10.7.2, “Configuring Resource Monitoring,” on page 210 

¢ Section 10.7.3, “Monitoring Services that Are Critical to a Resource,” on page 212 


¢ Section 10.7.4, “Example Monitor Scripts,” on page 213 


10.7.1 Understanding Resource Monitoring 


When you enable resource monitoring, you must specify a polling interval, a failure rate, a failure 
action, and a timeout value. These settings control how error conditions are resolved for the resource. 
¢ “Polling Interval” on page 209 
+ “Failure Rate” on page 209 
¢ “Failure Action” on page 209 
+ “Timeout Value” on page 210 
+ “How Resource Monitoring Works” on page 210 
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Polling Interval 


The monitor script runs at a frequency specified by the polling interval. By default, it runs every 
minute when the resource is online. You can specify the polling interval in minutes or seconds. The 
polling interval applies only to a given resource. 


Failure Rate 


The failure rate is the maximum number of failures (Maximum Local Failures) detected by the 
monitor script during a specified amount of time (Time Interval). 


A failure action is initiated when the resource monitor detects that the resource fails more times than 
the maximum number of local failures allowed to occur during the specified time interval. For failures 
that occur before it exceeds the maximum, Cluster Services automatically attempts to unload and 
load the resource. The progress and output of executing a monitor script are appended to /var/opt/ 
novell/log/nces/<resource_name>.monitor.out file. 


For example, if you set the failure rate to 3 failures in 10 minutes, the failure action is initiated if it fails 
4 times in a 10 minute period. For the first 3 failures, Cluster Services automatically attempts to 
unload and load the resource. 


Failure Action 


The Failover Action indicates whether you want the resource to be set to a comatose state, to 
migrate to another server, or to reboot the hosting node (without synchronizing or unmounting the 
disks) if a failure action initiates. With resource monitoring, the Start, Failover, and Failback Modes 
have no effect on where the resource migrates. This means that a resource that has been migrated 
by the resource monitoring failure action does not migrate back (fail back) to the node it migrated 
from unless you manually migrate it back. 


Set Resources as Comatose: (Default) If the failure action initiates, the resource is placed ina 
comatose state. Administrator action is required to take the resource offline, resolve the issue, and 
bring it online again on the same or different node. 


Migrate the Resource Based on the Preferred Nodes List: If the failure action initiates and the 
resource is on its most preferred node, the resource migrates to the next available node in its 
Preferred Nodes list, which you previously ordered according to your failover order preferences. The 
resource is not automatically failed back to the original node. Administrator action is required to 
cluster migrate the resource to the node, as desired. Each time a failure action triggers a failover, the 
resource migrates to a different node, according to the order in its Preferred Nodes list and availability 
of the nodes. 


Reboot the Hosting Node without Syncing or Unmounting Disks: If the failure action initiates, 
each of the resources on the hosting node will fail over to the next available node in its Preferred 
Nodes list because of the reboot. All resources on the node are failed over. This is a hard reboot, not 
a graceful one. The reboot option is normally used only for a mission-critical cluster resource that 
must remain available. The resources are not automatically failed back to the original node. 
Administrator action is required to cluster migrate them back to the node, as desired. 
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Timeout Value 


The timeout value determines how much time the script is given to complete. If the script does not 
complete within the specified time, the configured failure action is initiated. Cluster Services marks 
the process as failed right after the defined timeout expires, but it must wait for the process to 
conclude before it can start other resource operations. 


The timeout value is applied only when the resource is migrated to another node. It is not used during 
resource online/offline procedures. 


How Resource Monitoring Works 


1 The monitor script runs at the frequency you specify as the polling interval. 
2 There are two conditions that trigger a response by Novell Cluster Services: 
+ An error is returned. Go to Step 3. 
+ The script times out, and the process fails. Go to Step 4. 


3 Novell Cluster Services tallies the error occurrence, compares it to the configured failure rate, 
then does one of the following: 


¢ Total errors in the interval are less than or equal to the Maximum Local Failures: 


Novell Cluster Services tries to resolve the error by offlining the resource, then onlining the 
resource. 


If this problem resolution effort fails, Novell Cluster Services goes to Step 4 immediately 
regardless of the failure rate condition at that time. 


+ Total errors in the interval are more than the Maximum Local Failures: Go to Step 4. 
4 Novell Cluster Services initiates the configured failure action. Possible actions are: 

+ Puts the resource in a comatose state 

+ Migrates the resource to another server 


+ Reboots the hosting node (without synchronizing or unmounting the disks) 


10.7.2 Configuring Resource Monitoring 


The resource monitoring function allows you to monitor the health of a specified resource by using a 
script that you create or customize. If you want Novell Cluster Services to check the health status of a 
resource, you must enable and configure resource monitoring for that resource. Enabling resource 
monitoring requires you to specify a polling interval, a failure rate, a failure action, and a timeout 
value. 


If you are creating a new cluster resource, the Monitor Script page should already be displayed. You 
can start with Step 6. 

1 In iManager, select Clusters > My Clusters. 

2 Select the cluster that you want to manage. 


If the cluster does not appear in your list, add the cluster to your list as described in Section 8.2, 
“Setting Up a Personalized List of Clusters to Manage,” on page 117. 


3 Select the Cluster Options tab. 
4 Click the cluster resource to open its Properties page. 


You can also select the check box next to the resource, then click Details. 
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On the Properties page, click the Monitoring tab. 


My Clusters > clus1.ncs.novell > P_D_SERVER 


@ P_D_SERVER | 


Policies Preferred Nodes 


Scripts | Protocols 


Business Continuity 


To monitor the health of this resource, enable Resouce monitoring. You can set the interval to poll 
the resource's health, and set an action if it fails to successfully load on the maximum number of 
local restarts. Changes other than business continuity changes made to a resource will not take 
affect until the resource is reloaded 


Enable Resource Monitoring 


Polling Interval: (1 || Minutes > 


Failure Rate 


Maximum Local Failures: B3 | 
Time Interval: {10 || Minutes > | 
(Example: 3 Failures in S minutes) 


Failure Action 

ifthe Failure rate settings are reached, perform the following action 
(@)  SetResource as Comatose 
O Migrate the Resource based on the Preferred Nodes List 


CO) Rebootthe Hosting Node without Syncing or Unmounting Disks 


OK Cancel Apply | 


Select the Enable Resource Monitoring check box to enable resource monitoring for the 
selected resource. 


Resource monitoring is disabled by default. 


For the polling interval, specify how often you want the resource monitor script for this resource 
to run. 


You can specify the value in minutes or seconds. 


Specify the number of failures (Maximum Local Failures) for the specified amount of time (Time 
Interval). 


See “Failure Rate” on page 209. 


Specify the Failover Action by indicating whether you want the resource to be set to a comatose 
state, to migrate to another server, or to reboot the hosting node (without synchronizing or 
unmounting the disks) if a failure action initiates. The reboot option is normally used only for a 
mission-critical cluster resource that must remain available. 


See “Failure Action” on page 209. 
Click the Scripts tab, then click the Monitor Script link. 
Edit or add the necessary commands to the script to monitor the resource on the server. 


The resource templates included with Novell Cluster Services for Linux include resource monitor 
scripts that you can customize. 


You also need to personalize the script by replacing variables with actual values for your specific 
configuration, such as the mount point, IP address, volume group name, file system type, and 
mount device. 
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You can use the same commands that would be used at the Linux terminal console. For 
example, see Section 10.7.3, “Monitoring Services that Are Critical to a Resource,” on page 212. 


12 Specify the Monitor Script Timeout value, then click Apply to save the script. 


The timeout value determines how much time the script is given to complete. If the script does 
not complete within the specified time, the failure action you chose in Step 9 initiates. 


13 Do one of the following: 


¢ If you are configuring a new resource, click Next, then continue with Section 10.9.2, “Setting 
the Start, Failover, and Failback Modes for a Resource,” on page 215. 


+ Click Apply to save your changes. 


Changes for a resource’s properties are not applied while the resource is loaded or running 
on a server. Apply the updated script by taking the resource offline and then bringing it 
online on the same node. Alternatively, after the updated scripts have been synchronized 
from eDirectory to the source and destination nodes, the updated scripts are used 
automatically on system failover or cluster migration. For more information, see 

Section 10.8, “Applying Updated Resource Scripts by Offline/Offline, Failover, and 
Migration,” on page 213. 


Monitoring Services that Are Critical to a Resource 


In addition to monitoring the clustered service or storage objects, a resource monitor script can be 
used to monitor the status of services that are critical to the resource, such as Linux User 
Management (LUM), eDirectory, or other services. 


IMPORTANT: Beginning in OES 11 SP2, NCS provides the ability to monitor the status of the 
eDirectory daemon (ndsd) at the NCS level. It is disabled by default. The monitoring can be set 
independently on each node. It runs whenever NCS is running on the node. See Section 8.8, 
“Configuring NCS to Monitor the eDirectory Daemon (ndsd),” on page 132. 


If you enable NDSD monitoring at the NCS level, we recommend that you remove (or comment out) 
the eDirectory status check in individual monitor scripts to avoid excessive checking. 


The resource monitor script runs only on the cluster server where the cluster resource is currently 
online. The script does not monitor the critical services on its assigned cluster server when the 
resource is offline. The monitor script does not monitor critical services for any other cluster node. 
Each monitor script acts independently, so be aware of the potential traffic you might generate if you 
include a status check in multiple monitoring scripts. 


LUM Monitoring Example 


You can use the rcnamcd status command to monitor whether the Linux User Management service 
is running. Add the following command to the resource monitor script: 


# (optional) status of the Linux User Management service 
exit_on_error rcnamcd status 


Alternatively, you use the named status command to monitor whether the Linux User Management 
service is running and to automatically restart named if its daemon is not running. However, namcd 
creates messages in /var/log/messages with each check. Add the following command to the 
resource monitor script: 


# (optional) status of the LUM service and restart if it is not loaded or running 
exit_on_error namcd status 
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10.8 


eDirectory Monitoring Example 


You can monitor the state of the eDirectory service in an individual monitoring script by adding the 
following command. 


# (optional) status of the eDirectory service 
exit_on_error rcndsd status 


For OES 11 SP2 and later, you can alternatively monitor NDSD at the NCS level on each node. See 
Section 8.8, “Configuring NCS to Monitor the eDirectory Daemon (ndsd),” on page 132. 


Example Monitor Scripts 


The resource templates included with Novell Cluster Services for Linux include resource monitor 
scripts that you can customize. 


Example monitor scripts are available in the following sections: 


¢ Clustered NSS pool: 
¢ Section 12.8, “Configuring a Monitor Script for the Shared NSS Pool,” on page 264 
¢ Clustered LVM volume group: 
¢ “Sample LVM Resource Monitor Scripts Created by NSS Management Tools” on page 352 
¢ “Sample Generic LVM Resource Monitor Script” on page 367 
¢ “Sample LVM Resource Monitor Script with an NCP Virtual Server” on page 372 
¢ “Sample LVM Resource Monitor Script with an NCP Volume” on page 380 
¢ Legacy Clustered CSM container with Linux POSIX volumes: 


¢ Section 14.4.5, “Sample Monitor Script for a CSM Resource without a Segment Manager,” 
on page 407 


¢ Section 14.5.5, “Sample Monitor Script fora CSM Resource with a Segment Manager on It,” 
on page 414 


Applying Updated Resource Scripts by Offline/ 
Offline, Failover, and Migration 


For OES 11 SP1 (with the latest patches) and later, when you modify the load, unload, and monitor 
scripts for a resource and click Apply or OK, the updated resource scripts can take effect in any of the 
following ways: 


+ When an administrator takes the resource offline and then brings it online on the same node. 


+ When the resource fails over to another node, if both the source and destination nodes have 
received the updated scripts from eDirectory. 


+ When an administrator uses the cluster migrate command to load the resource on another 
node, if both the source and destination nodes have received the updated scripts from 
eDirectory. 


In earlier releases, script changes do not take effect until the resource is taken offline and then 
brought online. 


Configuring and Managing Cluster Resources 213 


10.9 


10.9.1 


The ability of the scripts to be applied on fail-over or migration to a different node depends on the 
synchronization of the updated scripts from the master node to eDirectory, and from eDirectory to the 
nodes in the cluster. The destination node will not run the updated scripts unless the updated scripts 
are visible on both the source node (where the resource is currently running) and the destination 
node. 


To verify that the updated scripts can take effect on the destination node: 


1 In a text editor, verify that both the source node and destination node have the updated scripts 
(resource_name.load, resource _name.unload and resource _name.monitor) under the / 
var/opt/novell/ncs/ directory. 


If the scripts are the same on both nodes, the updated scripts are applied on failover or migration 
between those nodes. 


2 Ifthe scripts are not the same on both nodes, pull the scripts down to the nodes from eDirectory: 
2a Ensure that eDirectory is fully synchronized. 


2b On the source node, pull down the scripts from eDirectory. Log on as the root user, opena 
terminal, then enter 


/opt/novell/ncs/bin/ncs-configd.py -init 


2c Repeat Step 2b for the destination node. 
3 Repeat Step 1 to verify that both the source node and destination node have the updated scripts. 


Configuring the Start, Failover, and Failback 
Modes for Cluster Resources 


You can configure the start, failover, and failback of cluster resources to happen manually or 
automatically. 


IMPORTANT: Cluster Services works with NCP user connections so that the user data sessions are 
resumed after failover. However, non-NCP users might experience service interruption and need to 
reconnect to the server after the failover. Applications using server based storage must be restarted 
on the client even with NCP unless they are NCP reconnect aware. 


¢ Section 10.9.1, “Understanding Cluster Resource Modes,” on page 214 
¢ Section 10.9.2, “Setting the Start, Failover, and Failback Modes for a Resource,” on page 215 


Understanding Cluster Resource Modes 


With the resource Start mode set to AUTO, the resource automatically starts on a server when the 
cluster is first brought up. If the resource Start mode is set to MANUAL, you can manually start the 
resource on a server when you want, instead of having it automatically start when servers in the 
cluster are brought up. 


With the resource Failover mode set to AUTO, the resource automatically starts on the next server in 
the Preferred Nodes list if there is a hardware or software failure. If the resource Failover mode is set 
to MANUAL, you can intervene after a failure occurs and before the resource is moved to another 
node. 


With the resource Failback mode set to DISABLE, the resource does not fail back to its most 
preferred node when the most preferred node rejoins the cluster. If the resource Failback mode is set 
to AUTO, the resource automatically fails back to its most preferred node when the most preferred 
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node rejoins the cluster. Set the resource Failback mode to MANUAL to prevent the resource from 
moving back to its preferred node when that node is brought back online, until you are ready to allow 
it to happen. 


The preferred node is the first server in the Preferred Nodes list for the resource. 


IMPORTANT: Resources fail back only to the first node in their Preferred Nodes list. For example, if a 
resource has failed over to three servers since it originally ran on its preferred node, and the second 
server the resource was running on comes back up, the resource does not fail back to that second 
server. 


Resources do not automatically move from node to node just because a node higher in the Preferred 
Nodes list rejoins the cluster, unless the Failback mode is set to AUTO and the first node in the 
Preferred Nodes list rejoins the cluster. 


Setting the Start, Failover, and Failback Modes fora 
Resource 


If you are creating a new cluster resource, the Resource Policies page should already be displayed. 
You can start with Step 6. 

1 In iManager, select Clusters > My Clusters. 

2 Select the cluster that you want to manage. 


If the cluster does not appear in your list, add the cluster to your list as described in Section 8.2, 
“Setting Up a Personalized List of Clusters to Manage,” on page 117. 


3 Select the Cluster Options tab. 
4 Select the cluster resource to open its Properties page. 

You can also select the check box next to the cluster resource, then click Details. 
5 On the Properties page, click the Policies tab. 


6 (Optional) Select the Resource Follows Master check box if you want to ensure that the 
resource runs only on the master node in the cluster. 


If the master node in the cluster fails, the resource fails over to whichever node becomes the 
master. 


7 (Optional) Select the Ignore Quorum check box if you don’t want the cluster-wide timeout period 
and node number limit enforced. 


The quorum default values were set when you installed Novell Cluster Services. You can change 
the quorum default values by accessing the properties page for the Cluster object. 


Selecting this box ensures that the resource is launched immediately on any server in the 
Preferred Nodes list as soon as any server in the list is brought online. 


8 Specify the Start, Failover, and Failback modes for this resource. 


The default for both Start and Failover modes is AUTO, and the default for Failback mode is 
DISABLE. 


9 Do one of the following: 


+ If you are configuring a new resource, click Next, then continue with Section 10.10, 
“Configuring Preferred Nodes and Node Failover Order for a Resource,” on page 216. 
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+ Click Apply to save your changes. 


Changes for a resource’s properties are not applied while the resource is loaded or running 
on a server. You must offline, then online the resource to activate the changes for the 
resource. 


Configuring Preferred Nodes and Node Failover 
Order for a Resource 


The Preferred Nodes page allows you to assign nodes to use for the resource. You also sequence the 
list of nodes to specify the preferred order that the nodes will be tried when a resource is brought 
online after its current node fails or if you do not specify a node when you bring the resource online. 
Changes are not allowed for the Preferred Nodes list for the Master_IP Address Resource. 


By default, a new resource is configured to run on all nodes, including future nodes. If its preferred 
node list is ever changed (directly or indirectly) by administrators, future nodes are not automatically 
added to the resource’s preferred nodes list. 


IMPORTANT: Ensure that you prepare the node for the services in the resource before you migrate 
or fail over the resource to it. 


If you are creating a new cluster resource, the Preferred Nodes page should already be displayed. If 
you are assigning nodes for an existing resource, the Preferred Nodes page is displayed as part of 
the Resource Policies page. You can start with Step 6. 

1 In iManager, select Clusters > My Clusters. 

2 Select the cluster that you want to manage. 


If the cluster does not appear in your list, add the cluster to your list as described in Section 8.2, 
“Setting Up a Personalized List of Clusters to Manage,” on page 117. 


3 Select the Cluster Options tab. 
4 Select the cluster resource to open its Properties page. 
You can also select the box next to the cluster resource, then click the Details link. 
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5 On the Properties page, click the Preferred Nodes tab. 


My Clusters > clus1.ncs.novell > POOL_D_SERVER 


f POOL_D_SERVER 


z 


Policies \ Monitoring } Preferred Nodes \ OEA Scripts \ Protocols \ Business Continuity 
View or change the preferred nodes for this cluster resource. 


Assigned: Unassigned: 


avalon 
newcastle 
london 
brighton 
merrifield 


dorset 
fairfax 


Ae A o 


OK | Cancel | Apply 


6 From the Unassigned Nodes area, select a node that the resource can use, then click the right- 
arrow button to move the selected node to the Assigned Nodes area. 


Repeat this step for all of the cluster nodes you want to assign to the resource. 


7 From the Assigned Nodes area, select a node that you want to unassign from the resource, then 
click the left-arrow button to move the selected node to the Unassigned Nodes area. 


8 Use one of the following methods to change the preferred failover order of the nodes assigned to 
a resource: 


+ Arrows: Select one of the assigned nodes by clicking on it, then click the up-arrow and 


down-arrow buttons to move the node up or down in the list. The page refreshes between 
each click on an arrow. 


Edit: Open the Preferred Nodes Edit function by clicking the Edit pen icon, list the assigned 


nodes in the preferred failover order with one node per line, then click OK to accept the 
revised order. 


Be careful to not alter the names of the nodes while editing the list. If you remove nodes 


from the list in the Edit view, the removed nodes are automatically added to the Unassigned 
Nodes area when you save. 


Edit Preferred Node List 


dorset 
fairfax 
london 
brighton 
merrifield 
avalon 
newcastle 


OK | Canet _| 
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9 At the bottom of the Preferred Nodes page, click Apply or OK to save the changes you made. 


The new list and failover order take effect immediately for OES 11 SP1 and later clusters, with 
the latest patches applied. It can take a few minutes for eDirectory to synchronize so the node 
can retrieve the updated list. 


10 (OES 11) Offline the resource, then online it again to apply the revised preferred nodes list and 
failover order. 

11 (Optional) Use the following command on the node where the resource is running to list the 
preferred nodes for the resource, and verify that the resource has the updated list. 


cluster migrate <resource_ name> -list 


10.11 Configuring Resource Priorities for Load Order 


Cluster resource priorities control the load order of a resource relative to other cluster resources on 
the same cluster node when bringing up a cluster, or during a failover or failoack. This is useful for 
ensuring that the most critical resources load first and are available to users before less critical 
resources. 

The Resource Priority setting controls the order in which multiple resources start on a given node 


when the cluster is brought up or during a failover or failback. For example, if a node fails and two 
resources fail over to another node, the resource priority determines which resource loads first. 


1 In iManager, select Clusters > My Clusters. 


2 Select the cluster that you want to manage. 


If the cluster does not appear in your list, add the cluster to your list as described in Section 8.2, 
“Setting Up a Personalized List of Clusters to Manage,” on page 117. 


3 Select the Cluster Options tab. 


4 On the Cluster Options page, click the Properties button above the Cluster Objects table to view 
the Cluster Properties dialog box. 


My Clusters > clus1.ncs.novell 


è clust.ncs.novell 


View cluster resource configuration information and administer cluster resources for the selected cluster 


Cluster Manager | BCC Manager \ Cluster Event Log F Cluster Options | Options 
Cluster Objects 


New | Delete | Details 13 Item(s) 
C Type Ẹ Name IP Address Distinguished Name Pool Name 


o b Master IP Address Resource 137.65.67.134 cn=clusl.ou=ncs,o=novell 


y avalon 137.65.67.37 — cn=avalon.cn=clus1.ou=ncs,o=novell 


0/0 


‘AV _Emplate 
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5 In the Cluster Properties dialog box, click the Priorities tab. 


è clust.ncs.novell 2 


Policies f ILLA Protocols | RME Groups \ Business Continuity 


View or change cluster resource priorities 
Resource Priorities 


POOL1_SERVER 
Ixvol1_server 

POOL2_SERVER 
POOL5_SERVER 
POOL3_SERVER 
POOL4_SERVER 
Ixvol2_server 


aw a 


OK | Cancel | Apply | 


6 Use either of the following methods to change the load order (from highest priority to lowest 
priority) of a resource relative to other cluster resources on the same node: 


+ Arrows: Select a resource in the list by clicking on it, then click the up-arrow or down-arrow 
buttons to move the resource up or down in the list. The page refreshes between each click 
on an arrow. 


+ Edit: Open the Resource Priority Edit function by clicking the Edit pen icon, list the 
resources in the preferred load order with one resource per line, then click OK to accept the 
revised order. 


Be careful to not alter the names of the resources while editing the list. 


Edit Cluster Resource Priorities ?] 


POOL1_SERVER 
Ixvol4_server 

POOL2_SERVER 
Ixvol2_server 

POOL5_SERVER 
POOL3_SERVER 
POOL4_SERVER 


7 Click Apply or OK to save changes and close the Cluster Properties dialog box. 


10.12 Configuring Resource Mutual Exclusion Groups 


The Resource Mutual Exclusion (RME) Groups feature allows you to define sets of resources that 
must not run on the same node at the same time. You might need to use RME Groups for resources 
when an application does not want its resource to run concurrently on the same node as other 
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applications. You can also use RME Groups if you run multiple instances of a service in the same 
cluster and they should run on different nodes. This Clusters plug-in feature is available only for OES 
2 SP3 and later servers. 


For example, because of the designs and supported configurations of Novell iPrint and GroupWise, 
the GroupWise and iPrint resources should not run on the same node at the same time. In addition, 
multiple iPrint server instances cannot be hosted on the same node. To avoid resource assignment 
conflicts, you could create an RME Group that consists of the GroupWise resource and the multiple 
iPrint resources. 

¢ Section 10.12.1, “Understanding Resource Mutual Exclusion,” on page 220 

è Section 10.12.2, “Setting Up RME Groups,” on page 222 


¢ Section 10.12.3, “Viewing RME Group Settings,” on page 223 


Understanding Resource Mutual Exclusion 


Resource Mutual Exclusion is the practice of letting a node run only one of the resources in an RME 
Group at a time. The resources can run concurrently on different nodes. 

+ “How RME Groups Work” on page 220 

+ “Rules for Node Assignment” on page 220 

+ “Examples” on page 221 


+ “Planning for RME Groups” on page 221 


How RME Groups Work 


When RME Groups exist, Novell Cluster Services does the following: 
+ It does not allow resources that are members of the same RME Group to run on the same node 
at the same time. 


¢ It evaluates the exclusions together, but separately enforces each group of exclusions. 


Rules for Node Assignment 


When a resource is brought online, Cluster Services honors the resource settings in the following 
order: 


1. Resource Follows Master 
2. Resource Mutual Exclusion Group 
3. Preferred Nodes list 


When onlining, migrating, or failing over a resource onto a node, Cluster Services evaluates RME 
settings to check if the resource is a member of any RME Groups, then assesses whether any one of 
the other resources in the RME Groups that the resource belongs to is already running there. If 
another resource from the same RME Group is running on the node, the situation is handled as if the 
node was not on the resource’s Preferred Nodes list. The checking process repeats itself with another 
node as a candidate until a suitable node is found, or until the resource’s Preferred Nodes list is 
exhausted. 


Resources that are not members of any of the RME Groups are not restricted. They are allowed to 
run at any time and in any combination on any node in their Preferred Nodes lists. 
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Examples 


If you try to cluster migrate a resource to a node where another member of its RME group is running, 
the resource is not migrated and remains in the Running state on the node where it is currently 
loaded. Only one resource in the group is allowed to run on the node at a time. 


If you try to cluster migrate multiple resources in an RME Group to the same node, the resources are 
brought online on different nodes. Only one of the resources (randomly selected) is brought online on 
the specified node. The other resources are migrated to different nodes in their Preferred Nodes lists. 


Planning for RME Groups 


An RME Group can contain any combination of the resources that are available to the cluster. 
Resources that are members of the same group are not allowed to run concurrently on a node. A 
resource can be a member of more than one group. 


You can define up to four groups (Group A, Group B, Group C, and Group D). The group names are 
fixed; they cannot be custom. 


For example, the following image shows an RME Groups page where three groups (A, B, and D) 
have been defined. The selected check boxes in a column indicate which resources belong to that 
group. Group A has four member resources, and Group B and Group D have three members each. 
The AUTO POOL 12 SERVER resource belongs to Group A and Group B. It has mutually exclusive 
relationships with two different sets of resources, and each exclusion is managed separately. 


Figure 10-1 Sample RME Groups 


& clus1.ncs.novell Z 


Policies Priorities Protocols F RME Groups | Business Continuity 


View or change Resource Mutual Exclusion (RME) group settings. 


Group A Group & Group C Group D 


¥ 
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RME Groups are supported when all cluster nodes are running running a supported platform. If you 
are managing an older version of Novell Cluster Services (without the RME code) from a new 
Clusters plug-in for iManager, the tables on the RME Groups page are shown as No items. You 
cannot set up RME Groups for clusters running on older platforms. 


Figure 10-2 Sample RME Groups Page for an Unsupported Platform 


è clus1.ncs.novell 2] 


Policies \ Priorities \ Protocols Business Continuity 


View or change Resource Mutual Exclusion (RME) group settings 


Name Group A GroupB GroupC GroupD 


No items 


OK | Cancel | Apply | 


If you are upgrading from an OES 2 SP2 or NetWare cluster, the RMS Groups are not available. You 
should wait until the rolling cluster upgrade has been completed on all nodes before you define RME 
Groups. If you define RME Groups while the cluster is in a mixed-mode condition, the RME Groups 
are honored only if the resource fails over to a cluster node where the new OS is running. 


10.12.2 Setting Up RME Groups 


To define sets of resources that must not be assigned to the same node at the same time: 


1 In iManager, select Clusters > My Clusters. 
2 Select the cluster that you want to manage. 


If the cluster does not appear in your list, add the cluster to your list as described in Section 8.2, 
“Setting Up a Personalized List of Clusters to Manage,” on page 117. 


3 Select the Cluster Options tab. 
4 On the Cluster Options page, click Properties, then click the RME Groups tab. 


The RME Groups page lists the resources in the cluster and columns for four possible RME 
Groups for the cluster. In each Group’s column, the check boxes correspond to the resources 
listed at the left. 


If you are managing an older version of Novell Cluster Services (without the RME code) from a 
new Clusters plug-in for iManager, the tables are shown as No items. You cannot set up RME 
Groups for clusters running on older platforms. 


5 To set up the members in a group, select the check boxes in the same column for two or more 
resources that must not be assigned on the same node at the same time. 


The selected resources in a column are not allowed to run concurrently on a node. A resource 
can be a member of more than one group. You can define up to four groups (A, B, C, and D). 
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 clus1.ncs.novell 


Policies \ Priorities \ Protocols 


Business Continuity 


View or change Resource Mutual Exclusion (RME) group settings. 
Name Group A GroupB GroupC GroupD 
Ixvol1_server A o o o 
Ixvol2_server v 4] D0 o 
Master_IP_Address_Resource C o 5| o 
POOL1_SERVER o A (m) o 
POOL2_SERVER o o o o 
POOL3_SERVER o o o o 
POOL4_SERVER Oo o o o 
POOL5_SERVER o E| o O 
OK | Cancel | Apply | 


6 Click OK or Apply to save your changes. 


Viewing RME Group Settings 


The RME Groups settings are displayed in the following locations: 


¢ “RME Groups in the Cluster Report” on page 223 
+ “RME Groups Configuration Page” on page 224 


RME Groups in the Cluster Report 


The Cluster Report has an RME Groups section that lists the member resources of each group. 


1 In iManager, select Clusters > My Clusters. 


2 Select the cluster you want to manage. 


3 Click Run Report, then scroll down to view the RME Groups. 


The RME Groups section lists only the resources in the cluster that are members in each of the 


RME Groups. 


For example, the following report shows the members for Groups A, B, and D. Group C has no 


defined members. The AUTO_POOL_12_SERVER resource belongs to two RME Groups. It has 


mutually exclusive relationships with two different groups of resources. These exclusions are 
managed separately. 


Resource Mutual Exclusion (RME) Groups 


Group A 


AUTO_POOL_12_SERVER 


ALITO_POO 
AUTO_POCL_0 


AUTO_POCL _02_ SERVER 


Group B 


AUTO_POOL_14_SERVER 
AUTO_POOL_12_SERVER 


AUTO_POOL_05_SERVER 


Group C GroupD 


AUTO_POOL_10_SERVER 


AUTO_POOL_O7_! 


Master_IP_Address_Resource 
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RME Groups Configuration Page 


The RME Groups configuration page displays all possible resources, and indicates membership by 
the check boxes that are selected in the same column under the RME Group Name. 

1 In iManager, select Clusters > My Clusters. 

2 Select the cluster that you want to manage. 


If the cluster does not appear in your list, add the cluster to your list as described in Section 8.2, 
“Setting Up a Personalized List of Clusters to Manage,” on page 117. 


3 Select the Cluster Options tab. 
4 Click Properties, then click the RME Groups tab. 


The RME Groups configuration page lists the all of the resources in the cluster. The selected 
check boxes in the same group column indicate their memberships in the four possible RME 
Groups. 


Controlling Resource Monitoring 


You can use the cluster monitor command to start, stop, or view the status of monitoring for a 
specified cluster resource. Issue the command as the root user from the node where the resource is 
currently loaded: 


cluster monitor <resourcename> {start | stop | status} 


Monitoring must be enabled for the resource. For instructions, see Section 10.7, “Enabling Monitoring 
and Configuring the Monitor Script,” on page 208. 


Changing the IP Address of a Cluster Resource 


Typically, IP addresses for cluster resources are assigned for the life of the resource. You can modify 
the IP address of a cluster resource if desired. For example, you might need to assign a cluster and 
its resources to a different IP subnet. 


Your setup must meet the following prerequisites: 


+ The resource must be in the Offline state in order to change its IP address. 


+ The new IP address must be unique in the network and available. It must satisfy the 
requirements described in Section 4.2, “IP Address Requirements,” on page 50. 


¢ eDirectory must be running and working properly when you attempt to modify the IP address for 
the cluster resource. 


Use the procedures in this section to modify the IP address for cluster resources: 


¢ Section 10.14.1, “Pool Cluster Resource,” on page 225 


¢ Section 10.14.2, “Non-Pool Cluster Resources,” on page 226 
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Pool Cluster Resource 


You can change the IP address of a pool cluster resource by using the Protocols page in the 
resource’s Properties in the Clusters plug-in for iManager. Ensure that you take the pool cluster 
resource offline before attempting to change its IP address. When you save the change, the load, 
unload, and monitor scripts are automatically updated with the new IP address. It also automatically 
updates the resource’s IP address that is stored in its NCP Virtual Server object. 


1 
2 


In iManager, select Clusters > My Clusters. 
Select the cluster that you want to manage. 


If the cluster does not appear in your list, add the cluster to your list as described in Section 8.2, 
“Setting Up a Personalized List of Clusters to Manage,” on page 117. 


On the Cluster Manager page, select the check box next to the pool cluster resource that you 
want to manage, then click Offline. 


Wait until the resource reports an Offline status before continuing. 


4 Select the pool cluster resource to open its Properties page. 


5 Select the Protocols tab. 


I POOL_D_SERVER z 


Policies \ Monitoring \ Preferred Nodes \ Scripts IOT Business Continuity 


Virtual Server Name: CLUS1-POOL-D-SERVER, ou=ncs, o=novell 
CIFS Server Name: =CLUS1-POOL-D-W 


IP Address [10.10.10.41 | 
Advertising Protocols: 

M arp 

Mi cars 


VI ncp 


In the IP Address field, type the new IP address for the cluster resource in IPv4 dotted decimal 
format (four octets of the address expressed individually in decimal and separated by periods). 


For example, type: 
10.10.10.43 


Click OK to save and apply the changes. 
The Cluster Options page opens. The new IP address is displayed for the pool cluster resource. 


® clus1.ncs.novell 


? 


View cluster resource configuration information 


dminister cluster resources for the 
Cluster Manager \ BCC Manager \ Cluster Event Log f Cluster Options } Options 


Cluster Objects 
New | Delete | Details 15 Item(s) 


O Type Ñ Name IP Address Distinguished Name Pool Name 


o a Master IP Address Resource 10.10.10.134 — cn=clus1,ou=ncs,o=novell 


O p avalon 10.10.10.37 cn=avalon,cn=clus1 ,ou=ncs,o=novell 


o a POOL D SERVER 10.10.10.43 cn=CLUS1-POOL-D-SERVER,ou=ncs,o=novell POOL_D 
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8 (Optional) Verify that the IP address has been changed in the pool cluster resource’s load, 
unload, and monitor scripts. 


8a On the Cluster Options page, select the cluster resource to open its Properties page, then 
select the Scripts tab. 


8b Select the Load, Unload, and Monitor options in turn, and review the scripts to verify that the 
resource IP address has been changed in all of the relevant places. 


9 Select the Cluster Manager tab. 


10 On the Cluster Manager page, select the check box next to the pool cluster resource, then click 
Online. 


Wait until the resource reports an Online status before continuing to ensure that the resource is 
working properly. 


10.14.2 Non-Pool Cluster Resources 


The properties for non-pool cluster resources do not include a Protocols page. You can change the IP 
address of a non-pool cluster resource by changing the IP address value for the RESOURCE_IP 
variable in its load, unload, and monitor scripts. 

1 In iManager, select Clusters > My Clusters. 

2 Select the cluster that you want to manage. 


If the cluster does not appear in your list, add the cluster to your list as described in Section 8.2, 
“Setting Up a Personalized List of Clusters to Manage,” on page 117. 


3 On the Cluster Manager page, select the check box next to the non-pool cluster resource that 
you want to manage, then click Offline. 


Wait until the resource reports an Offline status before continuing. 
4 Select the cluster resource to open its Properties page. 


5 Change the IP address value for the RESOURCE_IP variable in the load, unload, and monitor 
scripts: 


5a Select the Scripts tab. 
It automatically opens to the Load Script page. 
5b On the Load Script page, type the new IP address in the RESOURCE _IP variable, then 


click Apply. 

5c Click Unload Script, type the new IP address in the RESOURCE _IP variable, then click 
Apply. 

5d Click Monitor Script, type the new IP address in the RESOURCE _IP variable, then click 
Apply. 


5e Click OK to return to the Cluster Options page. 
6 Select the Cluster Manager tab. 


7 On the Cluster Manager page, select the check box next to the cluster resource, then click 
Online. 


Wait until the resource reports an Online status before continuing to ensure that the resource is 
working properly. 
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Renaming a Cluster Resource 


A cluster rename command is available that allows you to rename a cluster resource. Renaming 
the resource does not modify the virtual server name (the NCS:NCP Server object, such as cL134 - 
POOL1-SERVER). Renaming the cluster resource modifies only the name of the Cluster Resource 
object; it does not rename the clustered pool or clustered LVM volume that is managed by the 
resource. 


For an NSS pool cluster resource, renaming the cluster resource does not rename the pool and the 
resource scripts. For information about modifying the name of a cluster-enabled pool, see 
Section 12.12, “Renaming a Clustered NSS Pool,” on page 271. 


For a Linux LVM cluster resource, renaming the cluster resource does not rename the LVM volume 
and update the resource scripts. For information about modifying the name of a cluster-enabled LVM 
volume, see Section 13.9, “Renaming a Clustered LVM Logical Volume,” on page 382. 


Your setup must meet the following prerequisites: 


+ This command must be issued from the master node. 
+ The resource must be in the Offline state in order to be renamed. 
+ The new name must not exist prior to the renaming. 


¢ eDirectory must be running when you attempt to rename cluster resource. 
To rename the cluster resource: 


1 Log in to the master node in the cluster as the root user, and open a terminal console. 


2 Offline the cluster resource that you want to rename by entering 
cluster offline <resource_name> 
For example: 
cluster offline POOL1_SERVER 


You can use the cluster status command to verify that the resource reports an offline state 
before you continue. 


3 Rename the cluster resource by entering 
cluster rename <resource name> <new_resource_name> 
For example: 


cluster rename POOL1 SERVER custom_name22 
Resource 'POOL1 SERVER' has been renamed to 'custom_name22'. 


4 Online the cluster resource by entering 
cluster online <new_resource_name> 
For example: 


cluster online custom_name22 
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10.16 Deleting Cluster Resources, or Disabling 
Clustering for a Pool, LVM Volume Group, or 
Service 


You can delete a cluster resource for any of the following reasons: 


+ You want to re-create a Cluster Resource object. You want to remove the related objects in 
eDirectory and get the shared storage ready so that the resource can be re-created cleanly. 


To delete a resource and create a new one with the same name, you must wait to create the new 
one until eDirectory synchronizes all of the objects in the tree related to the deleted resource. 


+ You want to disable clustering for the shared storage managed by the resource. Afterwards, you 
will assign the SAN device to only a single node in the cluster. The storage will be available via 
the node’s IP address instead of the cluster resource IP address. 


+ You want to disable clustering for the shared service. The service will be available via the node’s 
IP address instead of the cluster resource IP address. 


+ You want to delete the shared storage managed by the resource. Afterwards, data is no longer 
available on any node in the cluster. 


We strongly recommend that you delete cluster resource objects only from the master node in the 
cluster. Ensure that you take the cluster resource offline before you attempt to delete the cluster 
resource, or before you attempt to delete cluster-enabled shared storage managed by the resource. 


WARNING: If you attempt to delete a storage cluster resource without first taking it offline, deletion 
errors occur, and the data associated with the clustered storage is not recoverable. 


All resource configuration must happen from the master node. On the Cluster Options page for 
iManager, you are automatically connected to the Cluster object, which is associated with the master 
node. On the Storage > Pools page for iManager, connect to the Cluster object, not to the individual 
servers. Run NSSMU only on the master node. 


Use the following procedure to delete a cluster resource: 


1 If the resource is on a non-master node in the cluster, migrate it to the master node. 
As the root user, open a terminal console, then enter 


cluster migrate <resource_ name> <master_node_name> 


The master node must be in the resource’s preferred nodes list. To view or modify the list, see 
Section 10.10, “Configuring Preferred Nodes and Node Failover Order for a Resource,” on 
page 216. 


2 If the cluster resource is online, take it offline by using one of the following methods: 


+ Enter the following at the command prompt as the root user: 
cluster offline <resource_name> 


Use the cluster status command to verify that the resource has a status of Offline before 
you continue. 


+ In iManager, go to Clusters > My Clusters, then select the cluster. On the Cluster Manager 
page, select the check box next to the cluster resource, then click Offline. 


Refresh the Cluster Manager page to verify that the resource has a status of Offline before 
you continue. 
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3 In iManager, use the Clusters plug-in to delete the cluster resource. 
3a Select Clusters > My Clusters, then select the cluster. 
3b Select the Cluster Options tab. 
3c Select the check box next to the resource, then click Delete. 


This deletes the Cluster Resource object. It does not delete the storage or service 
represented by the object. 


For a pool cluster resource, this also deletes the related NCP virtual server object, Pool 
object, and Volume object. 


For an NCP-enabled LVM cluster resource, this also deletes the related NCP virtual server 
object and Volume object. 


3d When you are prompted to confirm the deletion, click OK to continue, or click Cancel to 
abort the deletion. 


3e In the View Objects in iManager, browse to verify that the Cluster Resource objects and 
related objects were removed from eDirectory. 


If necessary, you can manually delete the objects. In iManager, go to Directory 
Administration > Delete Objects, select the objects, then click OK. 


If you are planning to delete a pool cluster resource or a Linux LVM volume using NSSMU, do 
the following: 


WARNING: Deleting a pool or a Linux LVM volume group destroys all data on it. 


Deleting a pool cluster resource: 
1. Take the resource offline. 
2. Open NSSMU, select Pools from the Main Menu. 
3. Select the pool, then press DELETE on your keyboard. 
This deletes the related NCP virtual server object, Pool object, and Volume object. 
Deleting a Linux LVM volume: 
1. Take the resource offline. 
2. Open NSSMU, select Linux Volumes from the Main Menu. 
3. Select the volume, then press DELETE on your keyboard. 
This deletes the related NCP virtual server object and Volume object. 


4 If the deleted resource was a pool cluster resource, use the Update eDirectory function to re- 
create Storage objects for the pool and its volumes. 


4a In iManager, select Storage > Pools, then select the master node if you plan to re-create the 
storage object, or select the node where you want the pool to reside as a locally available 
pool. 


4b Select the pool, then click Activate. 
4c Select the pool, then click Update eDirectory. 


This creates a Pool object in eDirectory with a name format of 
<server name> <pool name> POOL. 


4d Select Storage > Volumes. The server should still be selected. 
4e Select the volume, then click Mount. 
4f Select the volume, then click Update eDirectory. 


This creates a Volume object in eDirectory with a name format of 
<server name>_<volume_name>. 
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4g Repeat Step 4d through Step 4f for each volume in the pool. 


4h In the View Objects, browse to verify that the Pool object and Volume object were created. 


For example, the following View Objects shows the Pool object avalon_POOLD POOL and 
the Volume object avalon_VOLD were created for server avalon. 


Tree \ Browse \ Search \ 


Context: | novell } 


Type: |_All Available Types D 


Load Apply Save 


Objects: Multiple Select 

¢| avalon VOLD | a 
8 avalon 

© avalon-PS 


LDAP Server- avalon 


LDAP Group - avalon 
Http Server- avalon 
SAS Serice - avalon 


DNS AG avaion\ mtn example.com - avalon 


IP AG 10\ 10.10.37 - avalon 
SSL CertificateDNS - avalon 


SSL CertificatelP - avalon 


BUUAAEA LRA 


SNMP Group - avalon 
a UNIX Workstation - avalon 


ed UNIX Contig 
8 avalon POOLD POOL E 


<< Previous | nee) (100 ) 


Using NSSMU: You can also perform the same operations using NSSMU. 


1. 


5, 


5 Do one of the following: 


Open NSSMU, select Pools from the Main Menu, select the pool, then press F7 on your 
keyboard to activate. 


. Select the pool, then press F4 on your keyboard to update eDirectory. 


This creates a Pool object in eDirectory with a name format of 
<server name> <pool name> POOL. 


. Select Volumes from the Main Menu, select the volume, then press F7 on your keyboard to 


mount. 


. Select the volume, then press F4 on your keyboard to update eDirectory. 


This creates a Volume object in eDirectory with a name format of 
<server name>_<volume_name>. 


Repeat Step 3 through Step 4 for each volume in the pool. 


+ Re-create the cluster resource: Use the Clusters plug-in to cluster-enable the storage 


area. 


¢ To cluster-enable a pool, see Section 12.5, “Cluster-Enabling an Existing NSS Pool 
and Its Volumes,” on page 253. 


¢ To cluster-enable a Linux LVM volume group and logical volume, see Section 13.4.2, 
“Creating a Generic File System Cluster Resource for an LVM Volume Group,” on 
page 358 and Section 13.5, “Creating a Virtual Server Object for an LVM Volume 
Group Cluster Resource,” on page 367. 


To re-create the cluster resource with the same name, you must wait to create the new one 
until eDirectory synchronizes all of the objects in the tree related to the deleted resource. 
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+ Use the non-clustered pool: Unshare the devices that contribute space to the pool, then 
use a third-party SAN management tool to assign the devices to only the desired server. 


1. In iManager, go to Storage > Devices, then select the desired server (the one you 
specified in Step 4). 


2. Select the device. 
3. Deselect the Shareable for Clustering check box, then click Apply. 


Unsharing a device fails if the device contains a cluster-enabled pool or split-brain 
detector (SBD) partition. This is unlikely to be an issue if you used a dedicated device 
(or devices) for the pool where you have disabled clustering. 


4. Repeat these steps for each device that contributes space to the pool. 


5. Use a third-party SAN management tool to assign the devices to only the desired 
server. 


6. Provide the node’s IP address to users. 


+ Use the non-clustered Linux LVM volume: The LVM volume group uses the entire 
device. Clustered LVM (cLVM) still recognizes the multiple-node assignments from the 
SAN. 


1. Use a third-party SAN management tool to assign the device to only the desired server. 
2. Provide the node’s IP address to users. 


+ Use the non-clustered service: Modify information for your users so that they access the 
local node’s IP address instead of a clustered service IP address. 


+ Delete the pool or LVM volume group: If you do not want to keep the data, delete the 
shared storage area. 


WARNING: Deleting a pool or a Linux LVM volume group destroys all data on it. 


+ For shared NSS pools and volumes, use NSSMU, the Storage plug-in to iManager, or 
the nlvm delete pool <pool_name> command. Deleting the pool automatically 
deletes the volumes on it. 


¢ For Linux LVM volume groups, use NSSMU or the nlvm delete linux volume 
<volume_name> command. These tools automatically delete the LVM logical volume 
and logical volume group. If the volume was NCP-enabled, it also deletes the related 
NCP volume. 


10.17 Additional Information for Creating Cluster 
Resources 


Cluster resources can be configured for storage, services, or virtual machines. 


¢ Section 10.17.1, “Creating Storage Cluster Resources,” on page 232 
¢ Section 10.17.2, “Creating Service Cluster Resources,” on page 232 
¢ Section 10.17.3, “Creating Virtual Machine Cluster Resources,” on page 232 


Configuring and Managing Cluster Resources 231 


10.17.1 


10.17.2 


10.17.3 


Creating Storage Cluster Resources 


For information about creating cluster resources for shared storage on Linux, see the following: 


Table 10-3 Cluster-Enabling Shared Storage 


Shared Storage 


NSS pools and volumes 


Refer to 


Chapter 12, “Configuring and Managing Cluster 
Resources for Shared NSS Pools and Volumes,” on 
page 237 


Linux POSIX volumes 


Chapter 14, “Upgrading and Managing Cluster 
Resources for Linux POSIX Volumes with CSM 
Containers,” on page 399 


NCP volumes 


“Configuring NCP Volumes with Novell Cluster 
Services” in the OES 11 SP3: NCP Server for Linux 
Administration Guide 


Dynamic Storage Technology shadow volume pairs 
(shared NSS pools and volumes configured as DST 
pairs) 


“Configuring DST Shadow Volume Pairs with Novell 
Cluster Services” in the OES 11 SP3: Dynamic 
Storage Technology Administration Guide 


Creating Service Cluster Resources 


For information about creating cluster resources for various services, see Chapter 11, “Quick 
Reference for Clustering Services and Data,” on page 233. 


Creating Virtual Machine Cluster Resources 


If you install Novell Cluster Services at the host level of an OES virtualized server, you can create 
cluster resources for the virtual machines. See Section 15.2, “Virtual Machines as Cluster 


Resources,” on page 422. 
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Quick Reference for Clustering Services 


and Data 


You can use Novell Cluster Services to provide high-availability access to OES services and some 
Linux services. See the tables in this section for links to information about how to configure cluster 


resources for services and data. 


¢ Table 11-1, “Clustering OES Services with Novell Cluster Services,” on page 233 


¢ Table 11-2, “Clustering Storage with Novell Cluster Services,” on page 234 


¢ Table 11-3, “Clustering Linux Services with Novell Cluster Services,” on page 235 


Table 11-1 Clustering OES Services with Novell Cluster Services 


OES Service 


Archive and Version 
Services 


Certificate Server 


DFS VLDB 


(Distributed File Services 
volume location database) 


For clustering information, see 


“Configuring Archive and Version Service for Novell Cluster Services” in 
the OES 11 SP3: Novell Archive and Version Services Administration 
Guide. 


The NetIQ Certificate Server is not cluster-enabled. The Certificate Server 
service issues Server Certificate objects that might need to reside on each 
node in a cluster, depending on the service that is clustered. 


See “eDirectory Server Certificates” in the OES 11 SP3: Novell Cluster 
Services NetWare to Linux Conversion Guide. 


“Clustering Novell Distributed File Services” in the OES 11 SP3: Novell 
Distributed File Services Administration Guide for Linux. 


DHCP Server 


In the OES 11 SP3: Novell DNS/DHCP Services for Linux Administration 
Guide, see: 


+ “Configuring DHCP with Novell Cluster Services for the NSS File 
System” 


+ “Configuring DHCP with Novell Cluster Services for the Linux File 
System” 


DNS Server 


“Configuring DNS with Novell Cluster Services” in the OES 11 SP3: Novell 
DNS/DHCP Services for Linux Administration Guide. 


eDirectory 


File, AFP (Apple Filing 
Protocol) 


File, CIFS 


(Windows File Services) 


eDirectory is not clustered because it has its own replica system. 


“Configuring AFP with Novell Cluster Services for an NSS File System” in 
the OES 11 SP3: Novell AFP for Linux Administration Guide. 


“Configuring CIFS with Novell Cluster Services for an NSS File System” in 
the OES 11 SP3: Novell CIFS for Linux Administration Guide. 


File, NetStorage 


“Configuring NetStorage with Novell Cluster Services” in the OES 11 SP3: 
NetStorage Administration Guide for Linux. 
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OES Service For clustering information, see 


File, Samba “Configuring Samba for LVM Volume Groups and Novell Cluster Services” 
in the OES 11 SP3: Novell Samba Administration Guide. 


iFolder 3.9 “Clustering iFolder Servers with Novell Cluster Services for Linux” in the 
Novell iFolder 3.9.2 Administration Guide. 


iPrint “Configuring iPrint with Novell Cluster Services” in the OES 11 SP3: iPrint 
Linux Administration Guide. 


QuickFinder “Configuring QuickFinder Server for Novell Cluster Services” in the OES 11 


ie SP3: Novell QuickFinder Server 5.0 Administration Guide. 
(Server Synchronization 


Feature) 


Table 11-2 Clustering Storage with Novell Cluster Services 


Storage For clustering information, see 


Storage, Dynamic Storage Technology (DST) shadow “Configuring DST Shadow Volume Pairs with Novell 
volume pairs built with NSS volumes Cluster Services” in the OES 11 SP3: Dynamic 
Storage Technology Administration Guide. 


Storage, Linux POSIX volumes on legacy CSM Chapter 14, “Upgrading and Managing Cluster 
(Cluster Segment Manager) containers Resources for Linux POSIX Volumes with CSM 
Containers,” on page 399. 


Storage, LVM volume groups and logical volumes Chapter 13, “Configuring and Managing Cluster 
Resources for Shared LVM Volume Groups,” on 
page 327. 

Storage, NCP volumes + Section 13.6, “Enabling NCP File Access for a 


Clustered LVM Volume,” on page 373. 


+ “Configuring NCP Volumes with Novell Cluster 
Services” in the OES 11 SP3: NCP Server for 
Linux Administration Guide. 


+ “Clustering LVM Volume Groups with Novell 
Cluster Services” in the OES 11 SP3: Linux 
POSIX Volume Administration Guide. 


+ “Create Linux Volume” in the OES 11 SP3: NLVM 
Reference. 


Storage, NSS pools and volumes Chapter 12, “Configuring and Managing Cluster 
Resources for Shared NSS Pools and Volumes,” on 
page 237. 
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Table 11-3 Clustering Linux Services with Novell Cluster Services 


Linux Service 


Apache Web Server 


For clustering information, see 


“Apache HTTP Server” in the OES 11 SP3: Novell 
Cluster Services NetWare to Linux Conversion Guide. 


File, FTP “Cluster Enabling Pure-FTPd in an OES 11 SP3 
Environment” in the OES 11 SP3: Planning and 
Implementation Guide. 

MySQL “Configuring MySQL with Novell Cluster Services” in 


the OES 11 SP3: Web Services and Applications 
Guide. 


A MySQL template is available that uses a shared 
LVM volume group and logical volume that you have 
already created. 


Xen virtual machines 


Quick Reference for Clustering Services and Data 


Section 15.2, “Virtual Machines as Cluster 
Resources,” on page 422. 


You can use XEN and XENLive resource templates to 
configure virtual machines as cluster resources that 
can be failed over between host (Dom0) environments. 
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Configuring and Managing Cluster 
Resources for Shared NSS Pools and 
Volumes 


After you have installed and configured Novell Cluster Services on a server, you can configure Novell 
Storage Services (NSS) pool cluster resources. This section describes how to create and cluster- 
enable shared NSS pools volumes as pool cluster resources with Novell Cluster Services. 


+ 


+ 


+ 


+ 


+ 


Section 12.1, “Requirements for Creating Pool Cluster Resources,” on page 238 

Section 12.2, “Guidelines for Using Pool Cluster Resources,” on page 242 

Section 12.3, “Initializing and Sharing a SAN Device,” on page 243 

Section 12.4, “Creating Cluster-Enabled Pools and Volumes,” on page 247 

Section 12.5, “Cluster-Enabling an Existing NSS Pool and Its Volumes,” on page 253 
Section 12.6, “Configuring a Load Script for the Shared NSS Pool,” on page 260 

Section 12.7, “Configuring an Unload Script for the Shared NSS Pool,” on page 262 
Section 12.8, “Configuring a Monitor Script for the Shared NSS Pool,” on page 264 

Section 12.9, “Adding Advertising Protocols for NSS Pool Cluster Resources,” on page 265 
Section 12.10, “Adding NFS Export for a Clustered Pool Resource,” on page 266 

Section 12.11, “Mirroring and Cluster-Enabling Shared NSS Pools and Volumes,” on page 267 
Section 12.12, “Renaming a Clustered NSS Pool,” on page 271 

Section 12.13, “Renaming a Clustered NSS Volume,” on page 283 


Section 12.14, “Renaming the Mount Point Path for a Shared NSS Volume (Using a Custom 
Mount Point for a Shared NSS Volume),” on page 296 


Section 12.15, “Changing the Name Space for a Clustered NSS Volume,” on page 302 
Section 12.16, “Adding a Volume to a Clustered Pool,” on page 303 

Section 12.17, “Changing an Assigned Volume ID,” on page 304 

Section 12.18, “Expanding the Size of a Clustered Pool,” on page 304 

Section 12.19, “Deleting NSS Pool Cluster Resources,” on page 316 

Section 12.20, “Disabling Clustering for a Pool,” on page 316 


Section 12.21, “Deleting and Re-Creating a Pool Cluster Resource (Disabling and Re-Enabling 
Clustering for a Pool),” on page 318 


Section 12.22, “Deleting a Clustered Pool,” on page 322 
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12.1 


12.1.1 


12.1.2 


12.1.3 


12.1.4 


Requirements for Creating Pool Cluster 
Resources 


Your system must meet the requirements in this section in addition to the cluster requirements 
described in Chapter 4, “Planning for Novell Cluster Services,” on page 47. 

¢ Section 12.1.1, “Novell Cluster Services,” on page 238 

¢ Section 12.1.2, “Resource IP Address,” on page 238 

¢ Section 12.1.3, “eDirectory,” on page 238 

¢ Section 12.1.4, “Novell Storage Services,” on page 238 

¢ Section 12.1.5, “Shared Storage,” on page 240 

¢ Section 12.1.6, “NCP Server for Linux,” on page 240 

¢ Section 12.1.7, “Novell CIFS for Linux,” on page 241 

¢ Section 12.1.8, “Novell AFP for Linux,” on page 241 

¢ Section 12.1.9, “Novell Samba,” on page 242 

¢ Section 12.1.10, “Domain Services for Windows,” on page 242 


Novell Cluster Services 


Novell Cluster Services must be installed, configured, and running when you share devices and when 
you create manage the shared NSS pools and volumes. The cluster must be active. 


Resource IP Address 


Each NSS pool cluster resource requires a unique static IP address. The IP address is used to 
provide access to and failover capability for the pool cluster resource. Users access the pool by using 
the resource IP address instead of the server IP address where the pool is active. The IP address you 
assign to the pool remains assigned to the pool regardless of which server in the cluster is accessing 
the pool. 


IMPORTANT: The IP address for the virtual server must be in the same IP subnet as the server 
nodes in the cluster where you plan to use it. 


eDirectory 


Novell Cluster Services requires that eDirectory be running and working properly when you cluster- 
enable a pool and when you manage the pool. 


Novell Storage Services 


NSS must be installed and running on each server in the cluster. For information about installing NSS 
and managing NSS pools and volumes, see the OES 11 SP3: NSS File System Administration Guide 
for Linux. For information about using NLVM commands, see OES 11 SP3: NLVM Reference. 


In addition, the following requirements must be met: 


+ “Pool” on page 239 
+ “Volume” on page 239 
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+ “Naming Conventions” on page 239 
+ “Pool Cluster Resource Name” on page 239 


+ “Location of Cluster, Server, and Storage Objects” on page 240 


Pool 


We recommend that your pool cluster resource be one device, one pool, one volume. You can create 
a pool up to 8 TB in size on a single device by formatting the device in GPT format. 


You can create and cluster-enable a shared NSS pool by using the Storage plug-in for iManager, the 
server-based NSS Management Utility (nssmu), or the Novell Linux Volume Manager (NLVM) 
command line interface. You can also use these tools to create NSS volumes on the shared pool. 
These tools interact with Novell Cluster Services to create the pool cluster resource. 


You can cluster-enable an existing NSS pool by using the Clusters plug-in for iManager. 


Volume 


You must create at least one volume in the shared pool. Typically, you create all volumes for a shared 
pool when you set up the pool cluster resource and before you need to cluster migrate or fail over the 
resource to a different node in the cluster. 


For information about using antivirus software with NSS volumes, see “Antivirus Support for NSS” in 
the OES 11 SP3: NSS File System Administration Guide for Linux and “McAfee Antivirus Requires 
Additional Configuration” in the OES 11 SP3: Planning and Implementation Guide. 


Naming Conventions 


Pool names and volume names must comply with the same naming conventions. Names must be 2 
to 15 characters in length. Novell Cluster Services supports pool names with characters A to Z, 0 to 9, 
and underscores (_). The name cannot begin or end with an underscore; it cannot contain multiple 

adjacent underscores (__). It does not allow the following special characters in a shared pool name: 


!@#S%& () 


IMPORTANT: Before you cluster-enable an existing NSS pool, you must rename the pool and its 
volumes to use names that do not contain special characters. 


Pool Cluster Resource Name 


The pool name is used to form the default name of the pool cluster resource and the virtual server 
(the NCS:NCP Server object). If you modify the resource name, ensure that the name conforms to 
the resource naming conventions as described in Section 10.1.1, “Naming Conventions for Cluster 
Resources,” on page 194. 


Storage Object Default Name 
Resource name <cluster_name>_<poolname> 
Clustered Volume object name <cluster_name>_<volume_name> 


\\<cluster_name>-<poolname>-SERVER\<volume_name> 


Virtual server name <cluster_name>-<poolname>-SERVER 
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12.1.5 


12.1.6 


Location of Cluster, Server, and Storage Objects 


The Server, Pool, Volume, Cluster Resource, and Cluster objects are recommended to be in the 
same context (Such as ou=ncs,o=novell). It is supported for the objects to be in the same context or 
different contexts. If the objects are in different contexts, you might need to cluster migrate the pool 
cluster resource back to the context where the pool was created in order to modify the pool or 
volume, or to perform other tasks like setting up Distributed File Services junctions or home 
directories. You receive an eDirectory error if the operation cannot find the information that it needs in 
the same context. 


Shared Storage 


You should carefully plan how you want to configure your shared storage prior to installing Novell 
Cluster Services. Consider the guidelines and requirements in the following sections when planning 
your NSS storage solution. 

¢ Section 4.8, “Shared Disk Configuration Requirements,” on page 64 

¢ Section 4.9, “SAN Rules for LUN Masking,” on page 67 

¢ Section 4.10, “Multipath I/O Configuration Requirements,” on page 68 


NCP Server for Linux 


NetWare Core Protocol (NCP) is the Novell networking protocol used by the Novell Client. NCP is 
automatically selected as an advertising protocol when you cluster-enable an NSS pool. This is 
necessary to provide authenticated access to data using the Novell Trustee model. 


Novell Storage Services requires that the NCP Server for Linux service be installed and running on 
each node in the server. NCP Server must be running even if users access volumes on the shared 
NSS pool only via other protocols. 


WARNING: Cross-protocol file locking is required when using multiple protocols for data access on 
the same volume. This helps prevent possible data corruption that might occur from cross-protocol 
access to files. 


The NCP Cross-Protocol File Lock parameter is enabled by default when you install NCP Server. If 
you modify the Cross-Protocol File Lock parameter, you must modify the setting on all nodes in the 
cluster. 


NCP Server does not support cross-protocol locks across a cluster migration or failover of the 
resource. If a file is opened with multiple protocols when the migration or failover begins, the file 
should be closed and reopened after the migration or failover to acquire cross-protocol locks on the 
new node. 


See “Configuring Cross-Protocol File Locks for NCP Server” in the OES 11 SP3: NCP Server for 
Linux Administration Guide. 


NCP Server for Linux is installed by selecting NCP Server and Dynamic Storage Technology from the 
OES Services menu in the YaST install interface. For information about NCP Server for Linux, see 
the OES 11 SP3: NCP Server for Linux Administration Guide. 


You must specify an NCP virtual server name for the cluster-enabled pool. By default, the suggested 
name is in the form of <clusterName>-<poolName>-SERVER. You can accept the suggested name, or 
specify a custom name for the NCP virtual server name. If you are also enabling CIFS as an 
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12.1.7 


12.1.8 


advertising protocol, you might want to choose an NCP virtual server name that can also be used as 
the CIFS virtual server name. For information about using the NCP virtual server name as the CIFS 
virtual server name, see Section 12.1.7, “Novell CIFS for Linux,” on page 241. 


Novell CIFS for Linux 


Common Internet File System (CIFS) is the Windows networking protocol. Novell CIFS allows you to 
give clients access via CIFS to volumes on the shared NSS pool. 


WARNING: To prevent possible data corruption, enable the NCP Cross-Protocol File Locks 
parameter for NCP Server on all nodes in the cluster before you allow users to access the data. See 
“Configuring Cross-Protocol File Locks for NCP Server” in the OES 11 SP3: NCP Server for Linux 
Administration Guide. 


Novell CIFS must be installed, configured, and working properly before you can specify CIFS as an 
advertising protocol when you cluster-enable an NSS pool. Otherwise, the CIFS option is not 
available when you configure the resource. Novell CIFS for Linux is installed by selecting Novell CIFS 
from the OES Services menu in the YaST install interface. For information about Novell CIFS for 
Linux, see the OES 11 SP3: Novell CIFS for Linux Administration Guide. 


You must specify a CIFS virtual server name for the cluster enabled pool. You can accept the 
suggested name, or specify a custom name for the CIFS virtual server name. The name can be up to 
15 characters, which is a restriction of the CIFS protocol. 


For users to collaborate effectively, all paths for user access should be identical, independent of the 
access protocol used. This is possible only if the same name is used for the NCP virtual server name 
and the CIFS virtual server name, and the name can be only up to 15 characters. 


By default, the NCP virtual server name is suggested as the CIFS virtual server name. If the name is 
more than 15 characters, the CIFS virtual server name uses the rightmost 13 characters and adds -w. 
For example, an NCP virtual server name of CLUSTER1-P_USERS is modified to STER1-P_USERS-Ww for 
the CIFS virtual server name. If a default NCP virtual server name was used in the form of 
<clusterName>-<poolName>-SERVER and the name exceeds 15 characters, the CIFS virtual server 
name uses the rightmost 13 characters of the <clusterName>-<poolName> part of the name, and 
adds -w. For example, an NCP virtual server name of CLUS1-P123-SERVER is modified to cLUS1- 
P123-W for the CIFS virtual server name. 


If an administrator user later changes the NCP virtual server name for a clustered pool, NSSMU 
automatically modifies the CIFS virtual server name accordingly. To use a custom name for the CIFS 
virtual server name, you can modify the CIFS virtual server name by using the CIFS management 
tools. The custom CIFS name will not affect the NCP virtual server name. 


Novell AFP for Linux 


Apple Filing Protocol (AFP) is the Macintosh networking protocol. Novell AFP is required when you 
want to give Macintosh clients access via AFP to volumes on the shared NSS pool. 


WARNING: To prevent possible data corruption, enable the NCP Cross-Protocol File Locks 
parameter for NCP Server on all nodes in the cluster before you allow users to access the data. See 
“Configuring Cross-Protocol File Locks for NCP Server” in the OES 11 SP3: NCP Server for Linux 
Administration Guide. 
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12.1.9 


12.1.10 


12.2 


12.2.1 


Novell AFP must be installed, configured, and working properly before you specify AFP as an 
advertising protocol when you cluster-enable an NSS pool. Otherwise, the resource will be in a 
comatose state, and cannot be brought online. Novell AFP for Linux is installed by selecting Novell 
AFP from the OES Services menu in the YaST install interface. For information about Novell AFP for 
Linux, see the OES 11 SP3: Novell AFP for Linux Administration Guide. 


Novell Samba 


Novell Samba is supported for NSS pool cluster resources as an alternative to Novell CIFS. The 
setup is not integrated in the Advertising Protocols options when you cluster-enable a pool. If you do 
not use Novell CIFS, Novell Samba can be set up after you cluster-enable the pool. For information 
about setting up Novell Samba for storage resources, see “Configuring Samba for LVM Volume 
Groups and Novell Cluster Services” in the OES 11 SP3: Novell Samba Administration Guide. 


Novell Samba requires that users are enabled for Linux with Linux User Management (LUM). See 
OES 11 SP3: Novell Linux User Management Administration Guide. 


WARNING: To prevent possible data corruption, enable the NCP Cross-Protocol File Locks 
parameter for NCP Server on all nodes in the cluster before you allow users to access the data. See 
“Configuring Cross-Protocol File Locks for NCP Server” in the OES 11 SP3: NCP Server for Linux 
Administration Guide. 


Domain Services for Windows 


Cluster-enabled NSS volumes can be used in a Domain Services for Windows environment. 


Guidelines for Using Pool Cluster Resources 


Consider the guidelines in this section when working with shared NSS pools and volumes in the 
cluster: 

¢ Section 12.2.1, “Guidelines for Shared Pools,” on page 242 

è Section 12.2.2, “Guidelines for Shared Volumes,” on page 243 


Guidelines for Shared Pools 


+ When the pool cluster resource is brought online, the pool is automatically activated by the 
resource load script. You typically do not activate the pool at the terminal console. 


+ The unit of failover is the device (disk or LUN) that contains the pool. If you use multiple devices 
in the pool, all of those devices must be failed over together. 


IMPORTANT: As a best practice, we recommend a single LUN (or device) per shared pool, and 
one volume per pool. (one LUN=>one pool=>one volume) 


¢ If you delete a pool cluster resource, Novell Cluster Services automatically removes the Pool 
Resource object and the virtual server object from eDirectory. After you delete the resource, you 
can unshare the device and use the pool locally, or you can delete the pool and its volumes. 


Ensure that you offline the cluster resource before you attempt to delete the cluster resource or 
the pool. See Section 10.16, “Deleting Cluster Resources, or Disabling Clustering for a Pool, 
LVM Volume Group, or Service,” on page 228. 
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+ Before you rename a cluster-enabled pool, ensure that you offline the pool resource, activate the 
pool by using iManager or NSSMU, rename the pool, deactivate the pool, then online the pool 
resource. 


Novell Cluster Services automatically updates the pool resource load and unload scripts to 
reflect the name change. Also, NSS automatically changes the Pool Resource object name in 
eDirectory. 


Guidelines for Shared Volumes 


You must create at least one volume on a shared pool before you migrate it. As a best practice, we 
recommend that you create only one volume per shared pool. 


When you create a volume, commands are added to the pool resource load and unload scripts to 
automatically mount and dismount the volume when the scripts run. You can modify the load script to 
comment out the mount command so that you can manually mount the volume on a node in the 
cluster where the pool resource has been activated. 


Volumes on cluster-enabled pools do not appear as independent cluster resources. A cluster-enabled 
volume does not have an associated load and unload script or an assigned IP address. If you want 
each volume to be in a separate cluster resource, each volume must have its own pool. 


When a server fails, the cluster resources fail over to other servers in the cluster. Because the cluster- 
enabled pool fails over, all volumes in the pool also fail over, but only the volumes that have been 
added to the load script are automatically mounted. Any volumes in the pool that are not in the load 
script must be mounted manually. For this reason, volumes that you do not want to fail over should be 
in separate pools that are not cluster-enabled. 


When you create an encrypted NSS volume in a shared pool, you must mount the volume manually 
by using NSSMU and enter the password. NSS uses the password to create a key. Instead of storing 
it in the server memory as it does for non-shared volumes, NSS asks Novell Cluster Services to store 
the key and to pass it to the other nodes. After all servers hold the key, the volume is available for 
access as long as any one of the servers is still participating actively in the cluster. If all of the servers 
in the cluster fail, you must repeat this manual mounting procedure when you recover the cluster and 
restart services. 


If you delete a volume from a cluster-enabled pool, Novell Cluster Services automatically removes 
the volume mount command from the pool cluster resource load script. 


Initializing and Sharing a SAN Device 


NSS pools can be up to 8 TB in size and use space from one or more devices. For clustered pool 
resources, we recommend one device per pool. Each of the devices that you want to use for shared 
pool must be initialized and marked as shareable for clustering. 


You must initialize a device (disk or LUN) to set up its device format before you can create an NSS 
pool on it. You can also initialize a device to wipe its current structure and reconfigure it. Only 
initialized devices are visible to the NSS management tools when you create a pool. 


Initializing a device formats it with an MSDOS or a GPT partitioning scheme. MSDOS supports 
devices up to 2 TB in size. GPT supports devices of any size. The default is MSDOS. If the device 
size is greater than 2 TB and the partitioning scheme is not specified, the default partitioning scheme 
of MSDOS applies, and the device size is truncated to 2 TB with the remainder as unusable space. 
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WARNING: Initializing a device removes all partitions and data from the device. Do not initialize the 
device that contains the operating system. 


Devices that have never been initialized have a format of None. Devices that are being used fora 
Novell Cluster Services SBD (split brain detector) partition also have a format of None; however, you 
should not use initialization to remove an SBD partition. For information about removing an SBD 
partition, see Section 9.18, “Creating or Deleting Cluster SBD Partitions,” on page 173. After the SBD 
partition is removed, you can initialize the device. 


You can initialize and share a device by using the Storage plug-in for iManager, the Novell Storage 
Services (NSS) Management Utility (NSSMU), or the Novell Linux Volume Manager (NLVM) 
command line interface. 

¢ Section 12.3.1, “Initializing and Sharing a Device with iManager,” on page 244 

¢ Section 12.3.2, “Initializing and Sharing a Device with NSSMU,” on page 245 

¢ Section 12.3.3, “Initializing and Sharing a Device with NLVM,” on page 246 


Initializing and Sharing a Device with iManager 


1 Ensure that the SAN device is attached to all nodes in the cluster. 


2 Log in to iManager as an administrator user, then select Storage > Devices. 


3 Browse to select the Cluster object (5) of the cluster. 


Selecting the Cluster object automatically selects the server that is currently the master node in 
the cluster. 


4 From the Devices list, select the device where you want to create the pool. 


5 If the device has not been previously initialized or if you want to delete the current partitioning 
structures on the device, click Initialize Disk, then click OK to confirm and continue. 


WARNING: Initializing a disk destroys all of the data on it. 


6 If you are prompted, specify whether to use the GPT or DOS partitioning scheme, then click OK 
to complete the initialization. 


GPT can be used for any size device. DOS supports devices up to 2 TB in size. 
Wait for the page to refresh before continuing. 


7 Inthe Details area, select the Shareable for Clustering check box, then click OK to apply the 
change. 
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Devices 2| 


Manage and initialize a wide selection of physical and logical storage devices for the selected 
server. Enable device sharing for those devices that you plan to use in a high-availability cluster 
Manage priorities for connection path failover, where available 


Server: |avalon.novell | Qa 
Devices: Details: 
Initialize Disk | sda -|| Name: sdb 
Multipath on Major Number: 8 
Seepersuepsum | sdd Mnor Number: 16 
Reset Registry WM) Shareable for Clustering 
MBR Type: 
© vos @ cet 
Capacity 10102 MB 
Used Space: 32 KB 
Free Space: 10101.95 MB 
Pools: l JE 
Number of Pools 
[A Partitions: |Free - sdb1_r > | [ā] 
Status. 0% Remirrored, Unknown 
OK |__ Caneet__| App! 


8 Repeat Step 4 through Step 7 for each device that you want to use in the pool. 
9 Exit iManager. 


10 Continue with Section 12.4.1, “Creating a Cluster-Enabled Pool and Volume with iManager,” on 
page 247. 


12.3.2 Initializing and Sharing a Device with NSSMU 


1 Ensure that the SAN device is attached to all nodes in the cluster. 
2 Log in as the root user to the master node in the cluster, then open a terminal console. 


3 At the command prompt, enter: 
nssmu 
4 Inthe NSSMU, select Devices and press Enter. 


5 In the Devices list, select the device where you want to create the pool. 


6 If the device has not been initialized or if you want to delete the current partitioning structures on 
the device, press F3 to initialize the selected device, then press Y (Yes) to confirm and continue. 


WARNING: Initializing a disk destroys all of the data on it. 


7 Specify whether to use the GPT or DOS partitioning scheme, then click OK to complete the 
initialization. 
GPT can be used for any size device. DOS supports devices up to 2 TB in size. 
Wait for the page to refresh before continuing. 

8 Press F6 to mark the device as shareable for clustering. 


The Shareable for Clustering value changes from No to Yes. 
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Clustering: Yes 


F3=Init FS5=Refresh F6=UnShare SPACE=Select/Unselect F8=More 


9 Repeat Step 5 through Step 8 for each device that you want to use in the pool. 
10 Exit NSSMU. 


11 Continue with Section 12.4.2, “Creating a Cluster-Enabled Pool and Volume with NSSMU,” on 
page 250. 


12.3.3 Initializing and Sharing a Device with NLVM 


1 Ensure that the SAN device is attached to all nodes in the cluster. 
2 Log in as the root user to the master node in the cluster, then open a terminal console. 
3 View a list of active devices by entering 


nivm list devices 


4 Identify the device that you want to initialize. If a device contains data, be prepared to lose all 
data on the device when you initialize it. 


In the following example, the sdd and sde devices are uninitialized and display a format of None. 
The clus1.sbd device is a mirrored RAID device that is used for the SBD partition of a cluster 
named clus1. Do not select an SBD device. 


avalon:~/Desktop # nlvm list devices 


Name Size Used Free Format Shared RAID Enabled 
sda 11. 00GB 9,29GB 1.70GB MSDOS No No 

sdb 102.00MB 102.00MB OKB MSDOS Yes No 

sdc 102.00MB 102.00MB OKB MSDOS Yes No 

sdd 512. 00MB OKB OKB None No No 

sde 512. 00MB OKB OKB None No No 
clus134.sbd 99.57MB 99.57MB OKB None Yes 1 Yes 


5 Initialize the device by entering 
nlvm [--force] [--no-prompt] init <device name> [format=<gpt|msdos>] shared 


For command usage information, see “Init Device” in the OES 11 SP3: NLVM Reference. 


You are automatically prompted to confirm the initialize action. Respond Y (Yes) or N (No). Use 
the --no-prompt NLVM option to suppress the confirmation. 


Replace device_name with the node name of the device to be initialized, such as sde. The 
device name must be the first option after init. 


Specify gpt or msdos as the partitioning scheme to use when formatting the device. 
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The shared option marks the device as shareable for clustering after the initialization is 
complete. A small partition is created on the device to store the shared setting. 


For devices that contain data, you can specify the --force option to force the initialization if the 
init command cannot delete any pools on the disk. 


For example, to initialize a device with the MSDOS partitioning scheme and mark it as shareable 
for clustering, enter 


nivm init sde format=msdos shared 


6 List details about the device to verify that the device is formatted, and the amount of free space 
has increased. 


nlvm list device <device_name> 
For example, enter 
nlvm list device sde 


avalon:~/Desktop # nlvm list device sde 

Name= sde 
S1ze=512.00MB(1048576) Used=32KB(64) Free=511.95MB(1048479) 
Format=GPT Shared=No RAID=No M:M=8:80 H:S=255:32 


Creating Cluster-Enabled Pools and Volumes 


After you have installed and configured Novell Cluster Services, you can create a pool cluster 
resource by creating a cluster-enabled NSS pool and volume. 
¢ Section 12.4.1, “Creating a Cluster-Enabled Pool and Volume with iManager,” on page 247 
è Section 12.4.2, “Creating a Cluster-Enabled Pool and Volume with NSSMU,” on page 250 


Creating a Cluster-Enabled Pool and Volume with iManager 


1 Ensure that the SAN device is attached to all of the nodes in the cluster. 
2 Log in to iManager as an administrator user. 


3 If you have not already done so, initialize and share the device you want to use for the clustered 
pool. 


See Section 12.3, “Initializing and Sharing a SAN Device,” on page 243. We recommend one 
device per pool. If you use multiple devices, each device must be marked as Shareable for 
Clustering. 


4 Create a clustered pool: 


4a In Roles and Tasks, select Storage > Pools. 


4b Browse to select the Cluster object (>) of the cluster. 


Selecting the Cluster object automatically selects the server that is currently the master 
node in the cluster. The shared device will be assigned to this server and the pool and 
volume will be created there. After you create the clustered pool and volume, you can 
modify the resource’s preferred node order, then cluster migrate the volume to its most 
preferred node. 


4c Click the New link to open the New Pool wizard. 


4d Specify the new pool name, then click Next. 
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4e 


4f 


4g 


4h 


Select the check box next to the shared device where you want to create the pool, then 
specify the size of the pool. We recommend one that you use one device per pool. 


Select or deselect the Mount On Creation option. 


The Mount On Creation option determines if the pool you are creating is to be activated (the 
resource is brought online) as soon as it is created. 


The option is enabled by default. This allows you to create volumes immediately after you 
create the clustered pool. Default settings apply to the pool cluster resource and scripts, but 
you can modify them later. 


If you deselect the option, you can configure the resource and modify the scripts before you 
bring the resource online for the first time. You must bring the pool cluster resource online 
before you can create volumes on it. 


Select the Cluster Enable on Creation check box. 
This option is selected by default if the device is shared. 


If you deselect this option, you are not shown the Cluster Pool Information page. After you 
create a volume on the non-clustered pool, you can cluster-enable the pool and volume as 
described in Section 12.5, “Cluster-Enabling an Existing NSS Pool and Its Volumes,” on 
page 253. 


On the Cluster Pool Information page, specify the following information: 


Parameter Action 


Virtual Server Name (Optional) The default virtual server name for the resource is the cluster 
name plus the cluster resource name. For example, if the cluster name is 
cluster1 and the pool cluster resource name is POOL1_SERVER, then the 
default virtual server name is CLUSTER1 -POOL1-SERVER. 


You can use the suggested name, or specify a different Virtual Server 
name for the cluster resource. 


You can modify the cluster resource name after the resource has been 
created by using the cluster rename command. See Section 10.15, 
“Renaming a Cluster Resource,” on page 227. Changing the resource 
name does not modify the pool name or the virtual server name. 


CIFS Server Name (Optional) If Novell CIFS is installed and running, you can use this field to 
specify the name of the CIFS virtual server that CIFS clients see when they 
browse the network. 


If Novell CIFS is installed and running, but CIFS is disabled as an 
advertising protocol, this field is not available (dimmed). 


If Novell CIFS is not installed and running, this field value is 
NOT_SUPPORTED. 


CIFS is disabled by default as an advertising protocol. You can select the 
CIFS check box to enable it. By default, the NCP virtual server name is 
suggested as the CIFS virtual server name. For more information about 
how the default name is determined, see Section 12.1.7, “Novell CIFS for 
Linux,” on page 241. You can use the suggested name or specify a custom 
name for the CIFS virtual server name. 


If desired, specify a new name for the CIFS virtual server. The name can 
be up to 15 characters, which is a restriction of the CIFS protocol. 
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IP Address Specify an IP address for the pool cluster resource. Tab between the 
address fields. The address is IPv4 format, such as 10.10.10.243. 


Each pool cluster resource requires its own unique IP address. The IP 
address assigned to the pool remains assigned to the pool regardless of 
which server in the cluster hosts the pool. 


Advertising Protocols Select the check boxes of the advertising protocols (AFP, CIFS, NCP) that 
you want to enable for data requests to this shared pool. NCP is required to 
support authenticated access to data via the Novell Trustee model. 


Selecting a protocol causes commands to be added to the pool cluster 
resource’s load and unload scripts to activate the protocol for the resource. 
This lets you ensure that the cluster-enabled pool is highly available to 
users via the specified protocol. 


If the Novell CIFS or Novell AFP protocols are not installed and running, 
selecting the corresponding CIFS or AFP check box has no effect. 


Online Resource after The check box is deselected by default and dimmed so that you cannot 
Create change the setting. 


The pool is currently active on the server. You must deactivate the pool 
from the server before attempting to bring the resource online. You should 
also configure the resource load, unload, and monitor scripts before you 
bring the resource online. 


Define Additional Select the Define Additional Properties check box. 


Properties f . _ f 
This allows you to configure the resource policies for the start, failover, and 


failback modes, and to configure the preferred nodes. 


4i Click Finish. 


Typically, the pool creation takes less than a minute. However, if you have a large tree or if 
the server does not hold an eDirectory replica, the create time can take up to 3 minutes. 


The pool cluster resource should be online and active on the master node if the Mount on 
Creation option was enabled in Step 4f. 


5 Create a volume on the clustered pool. 


Repeat the following procedure for each cluster volume that you want to create on the shared 
pool. We recommend using only one volume per shared pool. 


5a In iManager, select Storage, then select the Volumes. 


5b Browse to select the Cluster object (È?) of the cluster. 


Selecting the Cluster object automatically selects the server that is currently the master 
node in the cluster. 


5c Click New. 
5d Specify the new volume name, then click Next. 
Each shared volume in the cluster must have a unique name across all nodes. 


5e Select the check box next to the cluster pool where you want to create the volume, select 
Allow the volume to grow to the size of the pool, then click Next. 


5f Review and change volume attributes by selecting or deselecting the check boxes next to 
the attributes. 


The Backup and Salvage Files attributes are selected by default. 
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For information about volume attributes, see “Volume Attributes” in the OES 11 SP3: NSS 
File System Administration Guide for Linux. 


5g Choose whether you want the volume activated and mounted when it is created, then click 
Finish. 
Typically, the volume creation takes less than 10 seconds. However, if you have a large tree 
or if the server does not hold an eDirectory replica, the create time can take up to 3 minutes. 

6 Verify that the pool cluster resource was created and is online. 

6a In iManager, select Clusters > My Clusters. 

6b Select the cluster. 
If the cluster is not in the list, click Add, browse to select its Cluster object, then click OK. 


6c On the Cluster Manager page in the Cluster Objects list, view the pool cluster resource, 
such as POOL1_ SERVER. 


If the resource is online, the state is Running. 
7 Continue with Section 12.6, “Configuring a Load Script for the Shared NSS Pool,” on page 260. 


12.4.2 Creating a Cluster-Enabled Pool and Volume with NSSMU 


1 Ensure that the SAN device is attached to all of the nodes in the cluster. 
2 On the master node, log in as the root user, then open a terminal console. 


3 If you have not already done so, initialize and share the device you want to use for the clustered 
pool. 


See Section 12.3, “Initializing and Sharing a SAN Device,” on page 243. We recommend one 
device per pool. If you use multiple devices, each device must be marked as Shareable for 
Clustering. 


4 Start NSSMU by entering nssmu at the command prompt. 
5 Create a clustered pool: 
5a From the NSSMU Main Menu, select Pools. 


5b On the Pools page, press Insert, type a name for the new pool you want to create, then 
press Enter. 


5c From the list of available devices, select the shared device where you want the pool created 
(such as sdc), then press Enter. 


Select the device you marked as shared for this purpose in Section 12.3, “Initializing and 
Sharing a SAN Device,” on page 243. 


5d Specify the amount of space (in MB) to use, then press Enter. 


Ins/ENTER=Select Del=Remove F3=Accept Select list U=Up D=Down ESC/Q=Prev Menu 
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Press F3 to accept the device and size settings. 


The Cluster Pool Information page opens automatically because the selected device is 
shared. 


Press (Y)es (N)o to set attributes ESC=Exit 


5f For the Activate On Creation option, specify whether you want the pool to be activated 


5g 


5h 


when it is created, then continue to the next field by pressing Enter. 


The Activate On Creation option determines if the pool you are creating is to be activated 
(the resource is brought online) as soon as it is created. 


The option is set to Yes (enabled) by default. This allows you to create volumes immediately 
after you create the clustered pool. Default settings apply to the pool cluster resource and 
scripts, but you can modify them later. 


If you set the value to No (disabled), you can configure the resource and modify the scripts 
before you bring the resource online for the first time. You must bring the pool cluster 
resource online before you can create volumes on it. 


Specify Yes for the Cluster Enable on Creation option. 
This option is selected by default if the device is shared. 


If you set the value to No, the values you set on the Cluster Pool Information page are 
ignored, and a pool cluster resource is not created. After you create a volume on the non- 
clustered pool, you can cluster-enable the pool and volume as described in Section 12.5, 
“Cluster-Enabling an Existing NSS Pool and Its Volumes,” on page 253. 


On the Cluster Pool Information page, specify the following information: 


Parameter Action 


Virtual Server Name (Optional) You can use the suggested name or specify a custom name for 
the NCP Virtual Server name. The default NCP virtual server name for the 
resource is the cluster name plus the cluster resource name. For example, 
if the cluster name is cluster1 and the pool cluster resource name is 
POOL1_SERVER, then the default virtual server name is CLUSTER1-POOL1 - 
SERVER. 


To modify the resource’s virtual server name, select the default name, 
press Enter, specify a new NCP Virtual Server name for the cluster 
resource, then press Enter. 


You can modify the cluster resource name after the resource has been 
created by using the cluster rename command. See Section 10.15, 
“Renaming a Cluster Resource,” on page 227. Changing the resource 
name does not modify the pool name or the virtual server name. 
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Parameter Action 


CIFS Server Name (Optional) If Novell CIFS is installed and running, you can use this field to 
specify the name of the CIFS virtual server that CIFS clients see when they 
browse the network. 


This field is blank by default if Novell CIFS is installed and running, but 
CIFS is disabled (set to No) as an advertising protocol. 


If Novell CIFS is not installed and running, this field value is 
NOT_SUPPORTED. 


CIFS is disabled by default as an advertising protocol. To enable CIFS as 
an advertising protocol, press the down-arrow to go to the CIFS field, then 
press y (Yes) to enable CIFS. By default, the NCP virtual server name is 
suggested as the basis for CIFS virtual server name. For more information 
about how the default name is determined, see Section 12.1.7, “Novell 
CIFS for Linux,” on page 241. You can use the suggested name or specify 
a custom name for the CIFS virtual server name. 


To modify the name, press the up-arrow to go the CIFS Server Name field, 
press Enter to select the suggested name, specify a new name for the 
CIFS virtual server, then press Enter. The name can be up to 15 
characters, which is a restriction of the CIFS protocol. 


IP Address Press enter to select the field, specify an IP address for the pool cluster 
resource, then press Enter. Specify the address in IPv4 format, such as 
10.10.10.243 


Each pool cluster resource requires its own unique IP address. The IP 
address assigned to the pool remains assigned to the pool regardless of 
which server in the cluster is accessing the pool. 


Advertising Protocols Press y (Yes) to enable an advertising protocol (AFP, CIFS, NCP) that you 
want to enable for data requests to this shared pool. Do not disable NCP; 
NCP is required to support authenticated access to data via the Novell 
Trustee model. 


Selecting a protocol causes commands to be added to the pool cluster 
resource’s load and unload scripts to activate the protocol for the resource. 
This lets you ensure that the cluster-enabled pool is highly available to 
users via the specified protocol. 


If the Novell CIFS or Novell AFP protocols are not installed and running, 
enabling the corresponding CIFS or AFP option has no effect. 


5i Select Apply to create and cluster-enable the pool. 


Typically, the pool creation takes less than a minute. However, if you have a large tree or if 
the server does not hold an eDirectory replica, the create time can take up to 3 minutes. 


6 Press Esc to return to the NSSMU Main Menu. 
7 Create a volume on the clustered pool. 


Repeat the following procedure for each cluster volume that you want to create on the shared 
NSS pool. We recommend using only one volume per shared pool. 


7a On the NSSMU Main Menu, select Volumes. 


7b On the Volumes page, press Insert, type a name for the new volume you want to create, 
then press Enter. 


Each shared volume in the cluster must have a unique name across all nodes. 
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7c Specify Y(es) to encrypt volume or N(o) to create a regular volume. 


7d From the list of available pools, select the clustered pool where you want the volume to 
reside, then press Enter. 


The new volume appears in the list of volumes. 


Typically, the volume creation takes less than 10 seconds. However, if you have a large tree 
or if the server does not hold an eDirectory replica, the create time can take up to 3 minutes. 


7e (Optional) From the list of volumes, select the newly created volume, press F8 to view more 
options, press Enter to open the Properties page to review and change volume attributes, 
then select Apply and press Enter to save any changes. 


The Backup and Salvage Files attributes are selected by default. 


For information about volume attributes, see “Volume Attributes” in the OES 11 SP3: NSS 
File System Administration Guide for Linux. 


8 Exit NSSMU. 

9 Verify that the pool cluster resource was created and is online. 
9a In iManager, select Clusters > My Clusters. 
9b Select the cluster. 


9c On the Cluster Manager page in the Cluster Objects list, view the pool cluster resource, 
such aS POOL1_ SERVER. 


If the resource is online, the state is Running. 
10 Continue with Section 12.6, “Configuring a Load Script for the Shared NSS Pool,” on page 260. 


Cluster-Enabling an Existing NSS Pool and Its 
Volumes 


Cluster-enabling an existing pool allows it (and its volumes) to be moved or mounted on different 
servers in the cluster in a manner that supports transparent client reconnect. This makes the data 
highly available to users. 


You might need to cluster enable an existing pool in at least the following situations: 


+ You are converting stand-alone servers with SAN attached devices to a cluster. 
+ You are migrating NSS pools between two separate clusters. 


In this scenario, you must create a Pool object and Volume objects in the new cluster context by 
using the Update eDirectory option in NSSMU or the Storage plug-in for iManager. 


+ You are creating a cluster resource from a storage-based snapshot. 


In this scenario, you must create a Pool object and Volume objects for the activated pool 
snapshot and its volumes by using the Update eDirectory option in NSSMU or the Storage plug- 
in for iManager. 


When you cluster-enable the exiting pool, its pool and volume information will be added automatically 
to the load, unload, and monitor scripts for the pool cluster resource. In addition, the volume entry is 
automatically removed from the /etc/f£stab so that the pool cluster resource load script controls 
when the volume is mounted. 


Before you cluster-enable the pool, we recommend that you deactivate it. The Online Resource after 
Creation option and pool state on the node when you begin determines the resource state and pool 
state after the resource is created, as described in the following table: 
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Pool State on Online Resource Pool State after the Resource Is Created 


the Node Resource State after 
After Creation Creation 
Setting 
Deactive Selected Online Active as a resource on a preferred node. 
Deactive Deselected Offline Deactive. 
Modify the resource settings and scripts as needed, then 
bring the resource online on a preferred node. 
Active Deselected Offline Active locally on the same node, even if the node is a 
preferred node. 
Modify the resource settings and scripts as needed, 
deactivate the pool locally, then bring the resource online 
on a preferred node. 
Active Selected Comatose Active locally on the same node, even if the node is a 


preferred node. 


Take the comatose resource offline. Modify the resource 
settings and scripts as needed, deactivate the pool locally, 
then bring the resource online on a preferred node. 


The default name of a pool cluster resource is the pool name plus the word “SERVER”, such as 
POOL1_ SERVER. You can modify the resource name after the resource has been created by using the 
cluster rename command. See Section 10.15, “Renaming a Cluster Resource,” on page 227. 
Changing the resource name does not modify the pool name or the virtual server name. 


After the pool cluster resource is brought online, users can access the cluster-enabled volume by 
using the IP address or virtual server name of its pool cluster resource. The default virtual server 
name of the resource is the cluster name plus the default cluster resource name, such as CLUSTER1- 
POOL1-SERVER. You can specify the name of the resource’s virtual server name when you cluster- 
enable the pool. 


The procedure in this section describes how to enable clustering for an existing pool and its volumes. 
It assumes the following: 


+ The pool contains at least one volume. 


+ The pool name meets the naming conventions supported by Novell Cluster Services. See 
“Naming Conventions” on page 239. 


If the pool name contains special characters, rename the pool by using NSS management tools. 
See “Renaming a Pool” in the OES 11 SP3: NSS File System Administration Guide for Linux. 


+ The pool and its volumes have Storage objects in the eDirectory tree where you are setting up 
the cluster. 


If the Pool and Volume objects are missing, you can create (or re-create) them in eDirectory by 

using the Update eDirectory option in the Storage plug-in for NSS or in NSSMU. You can do this 
from any node in the cluster. See “Updating eDirectory Pool Objects” and “Updating eDirectory 

Volume Objects” in the OES 11 SP3: NSS File System Administration Guide for Linux. 


+ The pool resides on a disk that has been enabled as Sharable for Clustering. If it is not shared, 
mark the device as shareable. You can use NSSMU, the nlvm share command, or the Storage 
> Devices task in Novell iManager to change the device’s share state. 


+ Each pool resource requires its own unique static IP address that is in the same IP subnet as the 
cluster IP address. 


254 OES 11 SP3: Novell Cluster Services for Linux Administration Guide 


+ To add CIFS as an advertising protocol when you cluster-enable an existing pool, you must 
install and configure Novell CIFS on the server, and ensure that the CIFS daemon is running and 
functioning properly before you begin. The CIFS daemon should also be running before trying to 
online the resource. 


+ To add AFP as an advertising protocol when you cluster-enable an existing pool, you must install 
and configure Novell AFP on the server, and ensure that the AFP daemon is running and 
functioning properly before you begin. The AFP daemon should also be running before trying to 
online the resource. 


¢ If you use special settings for mounting the volume, you must manually add those settings to the 
load script before you bring the resource online. 
To cluster-enable an existing NSS pool: 


1 Ensure that the SAN device is attached to all of the nodes in the cluster. 
2 Log in to iManager as a cluster administrator user. 
3 Deactivate the shared pool on the current server. 
3a In Roles and Tasks, select Storage > Pools. 
3b Browse to select the cluster where the pool is currently assigned. 
3c In the Pools list, select the pool, then click Deactivate. 
Wait until the page refreshes and confirms that the pool is deactive. 


4 Verify that the device is marked as shareable for clustering. If the pool uses multiple devices, you 
must verify the shared setting of each device. 


4a In Roles and Tasks, select Storage > Devices. 
4b Browse to select the cluster where the pool is currently assigned. 
4c Select the device to view its Details page. 


4d Ifthe Shareable for Clustering check box is deselected, select the check box, click Apply, 
read the warning, then click Continue to enable sharing. 


Marking the device as shareable automatically modifies the Shared attribute on the 
eDirectory objects for the pools and volumes on the device. 


Wait a couple of minutes before continuing to allow the attribute change to synchronize in 
eDirectory. You can verify the change in the shared state of the pool and its volumes by 
returning to the Pools page and Volumes page. 


4e Repeat this process for each device that is used by the pool. 
5 In Roles and Tasks, select Clusters > My Clusters, select the cluster, then click Cluster Options. 
6 On the Cluster Options page, click the New link in the Cluster Objects toolbar. 


7 On the Resource Type page, specify Pool (SP) as the resource type you want to create by 
clicking the Pool radio button. 


My Clusters > clus1.ncs.novell > New Resource 


New Resource [2] 
(=| Resource Type Select the type of cluster resource to create 
®© ® Pool 
D de Resource 
‘e  Emplate 
| Next | Cancet | 


8 At the bottom of the Resource Type page, click Next. 
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The Cluster Pool Information page opens. 


My Clusters > clus1.ncs novell > New Resource 


E] Cluster Pool Information Cluster-enable a pool. 


Pool Name: || 


A 


Virtual Server Name: | 

CIFS Server Name: 

IP Address: | 
Advertising Protocols: 
O arp 

O ars 


vV) NCP 


C online Resource after Creation 


Only select this option if you have verified that the pool is in an de-active state, otherwise the resource will go comatose during creation. 


M1 Define Additional Properties 


<<Back | Next>> | Cancel 


9 On the Cluster Pool Information page, specify the following information: 


Parameter 


Pool Name 


Action 


Specify the Pool Name by browsing to select the Pool object (@) of the pool 
you want to cluster-enable, such as servername_POOLC1_POOL. 


Browse Search 
Look in: Contents: (click object to select) 
{novell | t -~  uponelewl) 
(Example:novell) r8, 


TOOTO bipes ae Pooc roo 
g | © clus! POOL D POOL 


(Bample: A*, Lar*, Bob) 


After the pool is cluster enabled, the Pool object name is changed to 
clustername_POOLC1_POOL, such as clus1_POOLC1_POOL. 


Virtual Server Name 


(Optional) Change the default name of the Virtual Server for the cluster 
resource. 


The default virtual server name for the resource is the cluster name plus the 
cluster resource name. The default name of a pool cluster resource is the pool 
name plus the word “SERVER”, such aS POOL1_SERVER. 


For example, if the cluster name is clus1 and the pool cluster resource name 
iS POOL1_SERVER, then the default virtual server name is CLUS1-POOL1-SERVER. 


CIFS Server Name 


If CIFS is enabled as an advertising protocol, specify the name of the CIFS 
virtual server that CIFS clients see when they browse the network. The name 
can be up to 15 characters, which is a restriction of the CIFS protocol. 


By default, the NCP virtual server name is suggested as the CIFS virtual server 
name. For more information about how the default name is determined, see 
Section 12.1.7, “Novell CIFS for Linux,” on page 241. You can use the 
suggested name or specify a custom name for the CIFS virtual server name. 


If Novell CIFS is not installed and running, this field value is NoT_SUPPORTED. 
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Parameter 


IP Address 


Action 


Specify an IP address for the pool cluster resource. 


Each pool cluster resource requires its own unique IP address. The IP address 
assigned to the pool remains assigned to the pool regardless of which server in 
the cluster is accessing the pool. 


Advertising Protocols 


Online Resource after 


Select the check boxes of the advertising protocols (AFP, CIFS, NCP) that you 
want to enable for data requests to this shared pool. NCP is required to support 
authenticated access to data via the Novell Trustee model. 


Selecting a protocol causes commands to be added to the pool cluster 
resource’s load and unload scripts to activate the protocol for the resource. 
This lets you ensure that the cluster-enabled pool is highly available to users 
via the specified protocol. 


If the Novell CIFS or Novell AFP protocols are not installed and running, 
selecting the corresponding CIFS or AFP check box has no effect. 


The check box is deselected by default. 


Creation : . f ; . ; 
Select this option only if the pool is known to be currently in a deactive state; 
otherwise the resource goes comatose on creation because it will not 
automatically deactivate the pool from the local node. 

Define Additional Select the Define Additional Properties check box. 

Properties f ; : 
This allows you to configure the resource policies for the start, failover, and 
failback modes, and to configure the preferred nodes. 


i] Cluster Pool Information Cluster-enable a pool 


Pool Name: | avalon_POOLC1_POOL. novell a 


Virtual Server Name: [CLUS1-POOLC1-SERVER| 


CIFS Server Name: | CLUS1-POOLC1 

IP Address {10.10.1043 
Advertising Protocols: 

O arp 

O ars 

VI Ncp 


C] online Resource after Creation 


Only select this option if you have verified that the pool is in an de-active state, otherwise the resource will go comatose during creation 


™) Define Additional Properties 


10 At the bottom of the Cluster Pool Information page, click Next. 
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11 On the Resource Policies page, configure the resource policies for the start, failover, and 
failoack modes. 


See “Configuring the Start, Failover, and Failback Modes for Cluster Resources” on page 214. 


My Cheaters > chs nes ovel > New Resource 
New Resource 


DE| Resource Policies Set Start. Failover and Fallback modes for the new resource. 


[Failover Mode 
C Resource Fotows master © auo 
L) noe Quorum Manua 
[start Mode Failback Mode 
e Aito Auto 
Manua © Dswie 
e Marua 
Beo Next | _ Cei | 


12 At the bottom of the Resource Polices page, click Next. 
13 On the Resource Preferred Nodes page, assign the preferred nodes to use for the resource. 


By default, a new resource is configured to run on all nodes, including future nodes. Add the 
nodes you do not want to use to the Unassigned list. 


IMPORTANT: For Assigned nodes, ensure that you prepare the node for the services in the 
resource before you migrate or fail over the resource to it. 


See “Configuring Preferred Nodes and Node Failover Order for a Resource” on page 216. 


My Clusters > clus1.nes.novell > New Resource 


New Resource 
| Resource Preferred Nodes Assign or unassign nodes and change the node failover order. 
Assigned: Unassigned: 
avalon = dorset 
newcastle fairfax 
london 
brighton 
merrifield 
>] 
4] 
HH g 
< Back Finish | Cancel | 


14 At the bottom of the Resource Preferred Nodes page, click Finish. 


The pool cluster resource appears in the Cluster Objects list on the Cluster Options page, such 
aS POOL1 SERVER. 


The load, unload, and monitor scripts are automatically created with information about the pools 
and volumes. The volume entries are removed from the /etc/fstab file so that the resource 
load script can be used to control when the pools and volumes are mounted. The resource is 
offline. 


258 OES 11 SP3: Novell Cluster Services for Linux Administration Guide 


15 Verify that the pool cluster resource was created and that it is offline. 
15a In Roles and Tasks, select Clusters > My Clusters, select the cluster, then click Cluster 


Options. 


15b View the pool cluster resource in the Cluster Objects list, such aS POOLC1_SERVER. 


15c Select Cluster Manager, then view the pool cluster resource state as Offline. 


16 Verify the cluster resource scripts for the pool cluster resource, and modify them if desired. 


17 


18 


16a In Roles and Tasks, select Clusters > My Clusters, select the cluster, then click Cluster 


Options. 


16b Click the pool cluster resource link to open its Properties page. 


16c Configure the following resource settings: 


Property Action 

Monitoring (Optional) Select the Monitoring tab, select Enable Resource Monitoring, 
and configure monitoring as described in Section 10.7, “Enabling 
Monitoring and Configuring the Monitor Script,” on page 208. 

Load script Select the Scripts tab, select Load Script, then modify the script as 


Unload Script 


Monitor Script 


described in Section 12.6, “Configuring a Load Script for the Shared NSS 
Pool,” on page 260. 


Select the Scripts tab, select Unload Script, then modify the unload script 
as described in Section 12.7, “Configuring an Unload Script for the Shared 
NSS Pool,” on page 262. 


Select the Scripts tab, select Monitor Script, then modify the unload script 


as described in Section 10.7, “Enabling Monitoring and Configuring the 
Monitor Script,” on page 208. 


16d At the bottom of the page, click Apply or Ok to save your changes. 
The changes are not applied until the next time the resource is brought online. 


If you did not deactivate the pool before you began, manually deactivate the pool on its currently 


assigned node. 


You must deactivate the pool from the server before attempting to bring the pool cluster resource 


online. 
17a In Roles and Tasks, select Storage > Pools. 


17b Inthe Server field, browse to select the Cluster object (>) of the cluster. 


The Cluster object is automatically associated with the node that is currently the master 
node in the cluster. 


17c Inthe Pools list, select the pool, then click Deactivate. 
Wait until the page refreshes and confirms that the pool is deactive. 
Bring the resource online: 


18a In Roles and Tasks, select Clusters > My Clusters, select the cluster, then click Cluster 
Manager. 


18b Select the check box next to the pool cluster resource, then click Online to bring the 
resource online. 


Configuring and Managing Cluster Resources for Shared NSS Pools and Volumes 


259 


12.6 


12.6.1 


The pool is activated and its volumes are mounted on the primary preferred node that is 
configured for the pool cluster resource. 


If the pool is comatose, take the resource offline, then bring it online. If it goes comatose 
again, check the changes you made to the cluster scripts, then try again. 


Configuring a Load Script for the Shared NSS Pool 


A cluster resource load script is automatically generated for the pool when you cluster-enable it. You 
can modify the script as needed to suit your needs by using iManager. For information about how to 
access scripts for the cluster resource, see Section 10.5, “Configuring a Load Script for a Cluster 
Resource,” on page 206. 


Newly created pool cluster resources use the following sequence for commands in a load script. The 
order is reversed in an unload script. 


NSS (pool activation and volume mount) 

[NFS] (If NFS is used, you manually add the command here.) 
Secondary IP address 

NCP 

[AFP] 

[CIFS] 


If you modify the load script, you must take the pool cluster resource offline, then bring it online for the 
changes to take effect. 


IMPORTANT: Do not comment out commands that are automatically generated for parameters that 
define the cluster resource, such as the IP address, pool name, and volume name. 


If you need to modify the IP address, administrator credentials, or other attributes of an existing 
resource, follow the procedure in Section 8.13, “Moving a Cluster, or Changing the Node IP 
Addresses, LDAP Servers, or Administrator Credentials for a Cluster,” on page 143. 


¢ Section 12.6.1, “Sample NSS Load Script,” on page 260 

¢ Section 12.6.2, “Specifying a Custom Mount Point for an NSS Volume,” on page 261 
¢ Section 12.6.3, “Specifying Custom Mount Options,” on page 261 

¢ Section 12.6.4, “Loading Novell AFP as an Advertising Protocol,” on page 262 

¢ Section 12.6.5, “Loading Novell CIFS as an Advertising Protocol,” on page 262 


Sample NSS Load Script 


The following sample values are used in the NSS load script below: 


Variable Sample Value 

Cluster resource’s virtual server name NCS1-SHPOOL43-SERVER 
Resource IP address 10.10.10.43 

Pool name SHPOOL43 

Volume name SHVOL43 
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Variable Sample Value 


Volume ID 252 (valid values are 0 to 254) 


#!/bin/bash 
. /opt/novell/ncs/lib/nesfuncs 


exit _on_error nss /poolact=SHPOOL43 
exit_on_error ncpcon mount SHVOL43=252 


exit_on_error add_secondary_ipaddress 10.10.10.43 


exit_on_error ncpcon bind --ncpservername=NCS1-SHPOOL43 -SERVER 
--ipaddress=10.10.10.43 


exit 0 


12.6.2 Specifying a Custom Mount Point for an NSS Volume 


For NSS pool cluster resources, the default mount point of /media/nss/volume_name is assumed. In 
order to use a custom mount point, you must add some Linux commands to mount and dismount the 
volume from Linux at that location. For information about using a custom mount point path, see 
Section 12.14, “Renaming the Mount Point Path for a Shared NSS Volume (Using a Custom Mount 
Point for a Shared NSS Volume),” on page 296. 


12.6.3 Specifying Custom Mount Options 


The load script for an NSS volume assumes that the default name space of LONG is used when 
mounting the clustered NSS volume. Supported name spaces include LONG, UNIX, DOS, and MAC. 
For information about name spaces for NSS volumes, see “Lookup Namespace” in the OES 11 SP3: 
NSS File System Administration Guide for Linux. 


You can explicitly specify the desired name space by adding the following switch to the ncpcon 
mount command in the load script: 


/opt=ns=<long|unix|dos|mac> 


The options are case-sensitive. In the ncpcon mount command, place the /opt switch before the 
volume information. 


If you use a name space other than the default for the shared volume, or if you change the name 
space setting for shared volume by using NSSMU or the Storage plug-in for iManager, you must 
modify the load script for the pool cluster resource to add the name space to the ncpcon mount 
command for the volume. 


For example, to specify the LONG name space, add the /opt=ns=long switch as follows: 
exit _on_error nepcon mount /opt=ns=long <VOLUMENAME>=<VOLUMEID> 

For example, to specify the Unix name space, add the /opt=ns=unix switch as follows: 
exit_on_error ncpcon mount /opt=ns=unix <VOLUMENAME>=<VOLUMEID> 


After you modify the load script, you must take the pool cluster resource offline, then bring it online to 
apply the new name space setting for the volume. 
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12.6.4 


12.6.5 


12.7 


12.7.1 


Loading Novell AFP as an Advertising Protocol 


If you enable Novell AFP as a advertising protocol for the pool, the following command is 
automatically added below the bind command: 


exit_on_error cluster_afp.sh add CLUSTER-POOL1-SERVER 10.10.10.43 


The command uses the NCP virtual server name and the IP address of the pool cluster resource. 


Loading Novell CIFS as an Advertising Protocol 


If you enable Novell CIFS as an advertising protocol for the pool, the following command is 
automatically added below the bind command: 


exit_on_error novcifs --add 
'--vserver=".cn=CLUSTER-POOL1-SERVER.o=novell.t=AVALON_TREE."' 
--ip-addr=10.10.10.43 


The --vserver option uses the fully distinguished name of the NCP virtual server. The --ip-addr 
option uses the IP address of the pool cluster resource. 


ett lial an Unload Script for the Shared NSS 
Poo 


A cluster resource unload script is automatically generated for the pool when you cluster-enable it. 
You can modify the script as needed to suit your needs by using iManager. For information about how 
to access the scripts for a cluster resource, see Section 10.6, “Configuring an Unload Script for a 
Cluster Resource,” on page 207. 


Newly created pool cluster resources use the following sequence for commands in an unload script. 
The order is reversed in a load script. 


[CIFS] 

[AFP] 

NCP 

Secondary IP address 

[NFS] (If NFS is used, you manually add the command here.) 

NSS (pool deactivation, which automatically dismounts the volumes) 


If you modify the unload script, you must take the pool cluster resource offline, then bring it online for 
the changes to take effect. 


¢ Section 12.7.1, “Sample NSS Unload Script,” on page 262 

¢ Section 12.7.2, “Using Volume Dismount Commands,” on page 263 

¢ Section 12.7.3, “Unloading Novell AFP as an Advertising Protocol,” on page 263 
¢ Section 12.7.4, “Unloading Novell CIFS as an Advertising Protocol,” on page 263 


Sample NSS Unload Script 


The following sample values are used in the NSS unload script below: 
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12.7.2 


12.7.3 


12.7.4 


Variable Sample Value 


Cluster resource’s virtual server name NCS1-SHPOOL43-SERVER 
Resource IP address 10.10.10.43 

Pool name SHPOOL43 

Volume name SHVOL43 

Volume ID 252 (valid values are 0 to 254) 


#!/bin/bash 
/opt/novell/ncs/lib/nesfuncs 


ignore_error ncpcon unbind --ncpservername=NCS1-SHPOOL43-SERVER -- 
ipaddress=10.10.10.43 


ignore_error del_secondary_ipaddress 10.10.10.43 


ignore error nss /pooldeact=SHPOOL43 


exit 0 


Using Volume Dismount Commands 


By default, the pool deactivation automatically dismounts the volumes on the pool. The ncpcon 
dismount commands are not automatically added to the unload script. However, you can add ncpcon 
dismount commands for each volume before the pool deactivation line. For example: 


ignore _error ncpcon dismount SHVOL43 
ignore error nss /pooldeact=SHPOOL43 


Adding the ncpcon dismount command provides predictable and clean dismount behavior. It allows 
the volume dismount to occur and be logged independently of the pool deactivation, which can help 
with troubleshooting dismount issues. However, the ncpcon dismount commands are not 
automatically maintained and updated if you change a volume name or delete a volume. You must 
modify the unload script yourself. 


Unloading Novell AFP as an Advertising Protocol 


If Novell AFP is enabled as an advertising protocol for the pool, the following line is automatically 
added above the unbind command line: 


ignore_error cluster_afp.sh del CLUSTER-POOL1-SERVER 10.10.10.43 


Unloading Novell CIFS as an Advertising Protocol 


If Novell CIFS is enabled as an advertising protocol for the pool, the following line is automatically 
added above the unbind command: 


ignore error novcifs 


--remove '--vserver=".cn=CLUSTER-POOL1-SERVER.o=novell.t=AVALON_TREE."' 
--ip-addr=10.10.10.43 
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12.8 


12.8.1 


12.8.2 


Soo eng a Monitor Script for the Shared NSS 
Poo 


A cluster resource monitor script is automatically generated for the pool when you cluster-enable it. It 
is disabled by default. To enable or disable monitoring, see Section 10.7.2, “Configuring Resource 
Monitoring,” on page 210. 


If you modify the monitor script, you must take the pool cluster resource offline, then bring it online for 
the changes to take effect. 


¢ Section 12.8.1, “Sample NSS Monitor Script,” on page 264 
¢ Section 12.8.2, “Monitoring Novell AFP as an Advertising Protocol,” on page 264 
¢ Section 12.8.3, “Monitoring Novell CIFS as an Advertising Protocol,” on page 265 


Sample NSS Monitor Script 


The following sample values are used in the NSS monitor script below: 


Variable Sample Value 

Cluster resource’s virtual server name NCS1-SHPOOL43-SERVER 
Resource IP address 10.10.10.43 

Pool name SHPOOL43 

Volume name SHVOL43 

Volume ID 252 (valid values are 0 to 254) 


The following is a sample monitor script for an NSS pool cluster resource: 


#!/bin/bash 
. /opt/novell/nes/lib/nesfuncs 


exit _on_error status_fs /dev/pool/POOL1 /opt/novell/nss/mnt/.pools/POOL1 nsspool 
exit_on_error ncpcon volume VOL1 
exit_on_error status_secondary ipaddress 10.10.10.41 


exit 0 


You can add lines to the monitor script that check the status of processes used by clustering. See 
Section 10.7.3, “Monitoring Services that Are Critical to a Resource,” on page 212. 


Monitoring Novell AFP as an Advertising Protocol 


If Novell AFP is enabled as an advertising protocol for the pool, the Novell AFP status command 
(afpstat) is automatically added to help keep AFP up and running. It checks to see if the AFP 
daemon is running. 


exit_on_error afpstat 
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12.8.3 


12.9 


Monitoring Novell CIFS as an Advertising Protocol 


If Novell CIFS is enabled as an advertising protocol for the pool, the Novell CIFS monitoring 
command is automatically added to help keep CIFS up and running. 


exit_on_error rcnovell-cifs monitor 


The command checks to see if the cifsd daemon is running and takes action if it is not running. If 


CIFS is running, it returns its status. If CIFS is dead or not running, it starts the cifsd daemon and 
returns its status. If the restart fails, the resource’s failover settings are invoked, such as failing over 


the resource to its preferred node, or going comatose. Add the following line above the exit 
command: 


Pool cluster resources that were created on OES 2 SP3 and earlier clusters might use the CIFS 


status command in the monitor script. It checks the status and immediately invokes the resource’s 
failover settings if the cifsd daemon is not running. To take advantage of the restart capability that is 


offered by the monitor command, you can modify the line to use “monitor” instead of “status”. 


Adding Advertising Protocols for NSS Pool 
Cluster Resources 


Shared NSS pools support three advertising protocols: NCP (default, required), Novell AFP, and 
Novell CIFS. You can add Novell AFP or Novell CIFS as advertising protocols for an existing pool 


cluster resource. 


You must install Novell CIFS or Novell AFP on all the servers where you want to fail over the pool 


resource, but you set up the advertising protocol only once on the pool cluster resource. Before you 


begin, ensure that the pool is cluster migrated back to the server where it was originally created. 


1 Log in to iManager as a cluster administrator user. 


2 Offline the cluster resource that you want to modify. 


See Section 9.11, “Onlining and Offlining (Loading and Unloading) Cluster Resources from a 


Cluster Node,” on page 167. 


3 In Roles and Tasks, select Storage, then go the Volumes and Pools pages to verify that the 


volumes are not mounted and the pool is deactive. 


4 In Roles and Tasks, select Clusters > My Clusters, select the cluster, then select Cluster 
Options. 


5 On the Cluster Options page, use one of the following methods to open the Cluster Pool 
Properties page for the pool cluster resource that you want to manage: 
+ Select the check box next to the pool cluster resource, then click Details. 


+ Click the Name link for the pool cluster resource. 


Cluster Objects 


New | Delete | Details 
[~ Type [=| Name 


Master IP_Address Resource 


avalon 


See 


POOL1 SERVER 


6 On the Cluster Pool Properties page, click the Protocols tab. 


7 If you are enabling the resource for Novell AFP, select the AFP check box, then click Apply. 
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12.10 


8 If you are enabling the resource for Novell CIFS, select the CIFS check box and view the CIFS 
Virtual Server Name, then click Apply. 


A default name (up to 15 characters) is suggested for the CIFS Virtual Server Name when you 
first add the advertising protocol. 


If you later want to modify the CIFS Virtual Server Name, you must use the CIFS plug-in for 
iManager to manage the CIFS share name of an existing share. See “Setting CIFS General 
Server Parameters” in the OES 11 SP3: Novell CIFS for Linux Administration Guide. 


9 Online the cluster resource. Click Cluster Manager, select the check box next to the resource, 
then click Online. 


Adding NFS Export for a Clustered Pool Resource 


You can add NFS support for a clustered NSS volume by adding an exportfs (8) command to the 
load script and unload script for a clustered pool resource. Basically, the order in load script should be 
NSS, NFS, IP, and NCP. The order is reversed in the unload script. 


Before you use the export fs (8) Command in resource scripts, ensure that you install the nfs- 
kernel-server package on all of the cluster nodes in the resource’s preferred nodes list. This 
contains the support utilities for the kernel nfsd daemon. It is not installed by default. You can use the 
YaST > Software > Software Management tool to find and install the package. 


Figure 12-1 Using YaST Software Management to Install the nfs-kernel-server Package 


File Package Configuration Dependencies Options Extras Help 


| View yY | [Search|| RPM Groups _ Installation Summary | Ao 
Infsd {|| Search | | 
| Y Package Summary Installed (Availab Size 
Search in [Æ] nfs-kernel-server Support Utilities for Kernel nfsd (1.2.3-18.29.1) 247.0 KiB 
| Name 
| Keywords z : : 
Z) Summary Description | Technical Data Dependencies | Versions File List Change Log | 
[O Description nfs-kernel-server - Support Utilities for Kernel nfsd 
CO RPM "Provides" 
C RPM "Requires" This package contains support for the kernel based NFS server. You can tune the 
O File list number of server threads via the sysconfig variable USE_KERNEL_NFSD_NUMBER. For 
quota over NFS support, install the quota package. | 
Search Mode: Supportability: Level 3 | 
| Contains c| | 
O Case Sensitive 
5 Cancel | | Accept | 


¢ Section 12.10.1, “Sample NFS Load Script,” on page 267 
¢ Section 12.10.2, “Sample NFS Unload Script,” on page 267 
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12.10.2 


12.11 


12.11.1 


Sample NFS Load Script 


!/bin/bash 
. /opt/novell/ncs/lib/ncesfuncs 


Activate the NSS pool and mount its volume 
exit_on_error nss /poolact=POOL_16 
exit_on_error ncpcon mount VOL_161=224 


Start the NFS service 
exit_on_error rcnfsserver start 


Export the volume for NFS 
exit_on_error exportfs -o rw,sync,no_root_squash,fsid=216 *:/media/nss/VOL_161 


exit_on_error add_secondary_ipaddress 192.168.188.16 
exit_on_error ncpcon bind --ncpservername=CLUS1_POOL_16_ SERVER --ipaddress=192.168.188.16 


exit 0 


Sample NFS Unload Script 


#!/bin/bash 
. /opt/novell/necs/lib/nesfuncs 


ignore error ncpcon unbind --ncpservername=CLUS1_ POOL _16 SERVER --ipaddress=192.168.188.16 
ignore_error del_secondary_ipaddress 192.168.188.16 


#Unexport a volume for NFS 
ignore error exportfs -u *:/media/nss/VOL_161 


# Deactivate the pool and volume 
ignore_error nss /pooldeact=POOL 16 


exit 0 


Mirroring and Cluster-Enabling Shared NSS Pools 
and Volumes 


¢ Section 12.11.1, “Understanding NSS Mirroring,” on page 267 

¢ Section 12.11.2, “Requirements for NSS Mirroring,” on page 269 

¢ Section 12.11.3, “Creating and Mirroring NSS Pools on Shared Storage,” on page 269 
¢ Section 12.11.4, “Verifying the NSS Mirror Status in the Cluster,” on page 271 


Understanding NSS Mirroring 


NSS mirroring is a checkpoint-based synchronous mirroring solution. Data blocks are written 
synchronously to multiple storage devices. It is an alternative to synchronous replication options that 
are provided by a SAN storage array. 


Hardware configuration and placement for NSS mirroring can vary depending on geography and fault 
tolerance requirements. For example, Figure 12-2 depicts a simple hardware configuration in which 
one side of the mirrored NSS volume is located in a separate building from the rest of the cluster 
hardware. If a disaster occurs in one building, data is still safe on the mirrored NSS volume in the 
other building. 
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Figure 12-2 Single Cluster with Mirrored NSS Volumes in Separate Buildings 
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Figure 12-3 depicts a more complex hardware configuration in which two clusters are placed in 
separate buildings, but each has one side of a mirrored NSS volume in the building with the other 
cluster. If a disaster occur in one building, data is still safe and immediately accessible on the 
mirrored NSS volume in the other building. 


Figure 12-3 Two Clusters with Mirrored NSS Volumes in Separate Buildings 
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12.11.3 


The maximum distance for a single stretch of fibre without optical repeaters to boost distance is about 
10 kilometers. There are various devices available that convert Fibre Channel to IP in order to extend 
SANs to WAN scale. 


NSS mirroring is synchronous, and so mirror I/Os must complete before the next I/O can be sent. 
Performance is a function of time to do an I/O over the longest link. 


Requirements for NSS Mirroring 


NSS partitions must be mirrored after they are created. If you have an existing partition that you want 
to mirror, you can either create another partition of equal size on another device to mirror the first 
partition to, or let the mirroring software automatically create another partition of equal size on 
another device. 


Novell Cluster Services should be installed and running prior to creating and mirroring partitions on 
shared storage. 


When you create a Novell Cluster Services system that utilizes shared storage space (a Storage Area 
Network or SAN), it is important to remember that all servers attached to the shared device, whether 
in the cluster or not, have access to all of the volumes on the shared storage space unless you 
specifically prevent such access. Novell Cluster Services arbitrates access to shared volumes for all 
cluster nodes, but cannot protect shared volumes from being corrupted by non-cluster servers. 


Creating and Mirroring NSS Pools on Shared Storage 


Prior to creating and mirroring NSS partitions on shared storage, ensure that you have the following: 


+ OES 11 SP3 is installed on all servers that will be part of the cluster 

¢ All servers in the cluster are connected to a shared storage system 

+ One or more drive arrays are configured on the shared storage system 

+ Atleast 20 MB of free space on the shared storage system for a special cluster partition 

¢ To ensure disaster recovery, the device you select to mirror should be in a different storage array. 


Use one of the following methods to mirror clustered pool resources: 


+ “Creating a Pool on a Shared Mirrored Device” on page 269 


¢ “Mirroring the Partition of an Existing NSS Pool” on page 270 


Creating a Pool on a Shared Mirrored Device 


To create an NSS pool resource on a shared mirrored device: 


1 Start NSSMU by entering nssmu at the command prompt of a cluster server. 
2 Share the devices. 
2a Select Devices from the NSSMU Main Menu. 


2b Select the two devices that you want to use, then press F6 to mark the devices as Sharable 
for Clustering. 


3 Create a mirrored RAID device using the shared devices. 
3a Select RAID Devices from the NSSMU Main Menu. 


3b Press Insert to create a software RAID, select RAID 1, then press Enter. 
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3c Use the arrow keys to select the two shared devices that you want to contribute space to the 
RAID, specify the amount of space to use, then press Enter. 


The software RAID device automatically inherits the Sharable for Clustering setting. 
4 Create a clustered NSS pool on the shared RAID device. 
4a Select Pools from the NSSMU Main Menu. 


4b Press Insert to create a new pool, then create the clustered pool as usual on the shared 
software RAID device as described in Section 12.4.2, “Creating a Cluster-Enabled Pool and 
Volume with NSSMU,” on page 250. 


Mirroring the Partition of an Existing NSS Pool 


You can use NSSMU to mirror a clustered pool’s partition. The second device must have as much 
space available as you know the pool’s real allocated size to be, and be marked as Sharable for 
clustering. To mirror the partition for an existing clustered NSS pool resource: 
1 Start NSSMU by entering nssmu at the command prompt of a cluster server. 
2 Share the second device. 
2a Select Devices from the NSSMU Main Menu. 
2b Select the device that you want to use, then press F6 to mark it as Sharable for Clustering. 


To ensure disaster recovery, the device you select to mirror should be in a different storage 
array. 


3 Select Partitions from the NSSMU Main Menu. 


4 Press F3, choose the partition that contains the pool (even though it might not look like it has 
sufficient free space) and select the second shareable partition, then select Yes. 


This mirrors the existing pool and creates the RAID 1 device where each segment is the size of 
the pool. 


5 Use one of the following methods to initiate mirroring for the newly created mirror: 
+ Atthe terminal console of a cluster node, enter the following to migrate the cluster resource 
to another node: 
cluster migrate cluster_resource destination_node_name 
Migrating the pool causes load scripts to be executed and causes the mirroring to start on 
the new node. 
+ At the terminal console of the cluster node where the pool is currently active, enter: 


dmsetup message raid_device_name 0 remirror=on 


WARNING: Issue this command only on the node where the pool is currently active. Issuing 
the command on multiple nodes can corrupt the mirror. 


6 Verify that the remirroring has begun by opening NSSMU on the node where the pool is currently 
active, open the RAID page, then select the RAID device. 


The remirroring status shows a percentage that is greater than 0. It is fully synchronized at 
100%. 
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12.12 


After you have configured NSS mirroring with Novell Cluster Services, you should check to ensure 
that it is working properly in a cluster environment. 


1 Ensure that the volumes on the cluster-enabled pool are mounted on an assigned server by 
entering volumes at the terminal console. 


2 Check the mirror status of the mirrored partition by entering mirror status at the terminal 
console of the server where the NSS pool on the mirrored partition is active. 


After entering mirror status, you should see a message indicating that mirror status is 100 
percent or a message indicating that the mirrored object is fully synchronized. 


3 Migrate the pool to another server in the cluster and again check to ensure that the volumes on 
the pool are mounted by entering volumes at the terminal console. 


4 Check the mirror status of the partition again by entering mirror status at the terminal console. 


Renaming a Clustered NSS Pool 


When an NSS pool is cluster-enabled with Novell Cluster Services, special steps must be followed to 
rename the pool. The pool cluster resource must be taken offline during the renaming process. You 
can use NSSMU or the Storage plug-in to iManager to rename the shared pool. 


When you use an NSS management tool to rename a cluster-enabled pool, it automatically changes 
the Pool object name in eDirectory, updates the pool name for its Volume objects, and updates the 
pool name that appears in the load, unload, and monitor scripts for the pool’s cluster resource. The 
rename function does not change the names for the following resource objects: 


¢ Cluster resource name (Such aS POOL1_SERVER) 
You can use the cluster rename command to rename the resource. See Section 10.15, 
“Renaming a Cluster Resource,” on page 227. 

¢ Virtual server name (the NCS:NCP Server object, such as CLUS1-POOL1-SERVER) 

¢ CIFS virtual server name (Such as CLUS1-POOL1-Ww), if CIFS is enabled as an advertising 
protocol for the resource 


To rename a pool name in a way that also modifies names of resource objects, you can disable 
clustering for the pool, rename the pool, and then enable clustering for the renamed pool. This 
method is also described in Section 12.12.3, “Renaming a Shared Pool and Its Resource Objects,” on 
page 277. 


Because renaming requires that information is modified in eDirectory, you should rename the pool 
from the master node. NSS management tools require that the shared pool is active locally on a 
cluster node that has its NCP Server object in the same context as the Pool object of the pool you 
want to rename. The server must also be in the resource’s Preferred Nodes list to migrate to it. To 
view or modify the list, see Section 10.10, “Configuring Preferred Nodes and Node Failover Order for 
a Resource,” on page 216. 


You can use any of the methods in this section to rename a shared pool. 


¢ Section 12.12.1, “Renaming a Shared Pool with iManager,” on page 272 

¢ Section 12.12.2, “Renaming a Shared Pool with NSSMU,” on page 274 

¢ Section 12.12.3, “Renaming a Shared Pool and Its Resource Objects,” on page 277 
¢ Section 12.12.4, “Renaming a Shared Pool in a DST Cluster Resource,” on page 281 


Configuring and Managing Cluster Resources for Shared NSS Pools and Volumes 271 


12.12.1 Renaming a Shared Pool with iManager 


1 Ensure that the pool cluster resource is running on the master node. 
If you need to migrate the resource: 
la In iManager, select Clusters > My Clusters, then select the cluster that you want to manage. 


1b On the Cluster Manager page, select the check box next to the pool cluster resource, then 
click Migrate. 


1c Select the master node, then click OK. 
Wait for the resource to report a Running state before you continue. 


2 Take the pool cluster resource offline. On the Cluster Manager page, select the check box next 
to the pool cluster resource, then click Offline. 


Wait for the resource to report an Offline state before you continue. 
3 Activate the pool locally on the master node: 
3a In iManager, select Storage > Pools. 
3b Select the node where you took the resource offline. 
3c Select the pool, then click Activate. 


Storage 


Pools 2 


Create and manage 
preserve point-in-tir 


to the pool to meet demand. Use snapshots to 
y and backup 


Server: |avalon.novell | Ql Fal 
Pools: Details: 
New... POOL1 Name POOL1 
Delete Mount Point Joptinovell/nss/mnt/.pools/POOL1 
Rename... a 
Partitions sdd1.1 sja 
EEE Number of Partitions: 1 
Deactivate | State Active 
_Increase size... | LSS Type ZLSS 
EEUE Share State Sharable for Clustering 
Properties... Volumes | VOL1 ° | 
_Update eDirectory | 
Number of Volumes 1 
Deleted Volumes. (aaa sh 
Offline Devices ea 
Number of Devices: 1 


4 Rename the shared pool: 
4a In the Pools list, select the pool, then click Rename. 


4b Read the warning message that the pool’s volumes will be dismounted, then click OK to 
confirm that you want to rename the pool. 


If you rename a pool on a Linux server, NSS immediately dismounts its volumes. Click OK to 
rename the pool 
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4c Inthe Rename Pool dialog box, type the new name, then click Finish. 


Rename Pool 2) 
Enter a new name 


2 to 15 characters a 
with the _ (u 


L @.# $, %, & ( 


ain __ (multiple under 


Name 
PUSERS 
<<Back _ | Finish | Cancel | 


4d Read the error message, then click OK to dismiss it. 


Error 23391 is EDIR OBJECT NOT FOUND. Typically, it means that the old Pool object has 
been removed successfully and can no longer be found. 


», Error: Unknown error with error code: 23391. 
Close 


4e View the renamed pool in the Pools list. 


After the rename, the pool is in a deactive state. 


Storage 


Pools 
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eate and mana 
e point-in- 
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Server: |avalon.novell ala 
Pools: Details: 
New! (SSS | Name PUSERS 
Delete Mount Point Jopt/novell/nss/mnt/.pools/PUSERS 
Rename.. | oma EI 
ee Partitions YJ 
Activate | Number of Partitions: 0 
Deactivate State Deactive 
Increase size.. LSS Type 
Snapshot. Share State 
ee Volumes | | 
Dium Number of Volumes: 0 
Deleted Volumes... [sa 20 
a Devices yada, vYA 
Offline 
Number of Devices 1 


5 Verify that the pool name was modified in the pool resource scripts: 
5a In iManager, select Clusters > My Clusters, then select the cluster that you want to manage. 
5b On the Cluster Manager page, click the name link of the pool resource. 


The pool resource name has not been modified by the pool rename. Its default name is 
<old_pool_name>_SERVER. 


5c On the Resource Properties page, click the Scripts tab. 
5d Verify that the new pool name is used in the load, unload, and monitor scripts. 


Remember that the resource name and virtual server name are not modified by a pool 
rename. Do not modify those names in scripts. 


5d1 On the Load Script page, verify that the pool name was changed in the nss command. 
If you modify the load script, click Apply. 


exit_on_error nss /poolact=<new_pool_name> 


For example: 
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exit_on_error nss /poolact=PUSERS 


5d2 Click Unload Script, then verify that the pool name was changed in the nss command. 
Also check any custom commands where the volume name appears. If you modify the 
unload script, click Apply. 


exit_on_error nss /pooldeact=<new_pool_name> 
For example: 
exit_on_error nss /pooldeact=PUSERS 


5d3 Click Monitor Script, then verify that the pool name was changed in the status_fs 
command. Also check any custom commands where the pool name appears. If you 
modify the monitor script, click Apply. 


exit _on_error status_fs /dev/pool/<new_pool_name> /opt/novell/nss/mnt/ 
-pools/<new_pool_name> 


For example: 


exit_on_error status_fs /dev/pool/PUSERS /opt/novell/nss/mnt/.pools/ 
PUSERS 


5e Click Cancel to return to the Cluster Manager page, or click OK to apply any changes you 
made in the scripts. 


6 Bring the pool cluster resource online: 
6a In iManager, select Clusters > My Clusters, then select the cluster that you want to manage. 


6b On the Cluster Manager page, select the check box next to the pool cluster resource, then 
click Online. 


The resource is brought online on a node in its Preferred Nodes list, according to 
availability. Wait for the resource to report a Running state before you continue. 


7 (Optional) Rename the pool cluster resource. For example, rename POOL1 SERVER as 
PUSERS_ SERVER. 


For instructions, see Section 10.15, “Renaming a Cluster Resource,” on page 227. 


12.12.2 Renaming a Shared Pool with NSSMU 


1 Log in to the master node as the root user, then launch a terminal console. 


2 Ensure that the pool cluster resource is running on the master node. Enter 
cluster status 
If you need to migrate the resource, enter the following at the command prompt: 
cluster migrate <resource_name> <master_node_name> 

3 Take the pool cluster resource offline. At the command prompt, enter 
cluster offline <resource_name> 
You can verify the offline state by entering 
cluster status 


4 Activate the pool locally on the master node: 
4a At the command prompt, enter 
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nssmu 


4b Select Pools to view a list of pools. The pool state is Deactive. 


5 Rename the pool: 
5a On the NSSMU Pools page, select the pool. 
5b Press F6 Rename. 


5c Read the warning message that the pool’s volumes will be dismounted, then click OK to 
confirm that you want to rename the pool. 
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5d Specify the new name, then press Enter. 


5e Read the error message, then press o (Ok) or press Enter to dismiss it. 


Error 23391 is EDIR OBJECT NOT FOUND. Typically, it means that the old Pool object has 
been removed successfully and can no longer be found. 


5f After the rename, the pool is in a deactive state. 


‘Ins=Creat fresh F7=Activate | Volumes S=Segments 


6 Press Esc twice to exit NSSMU. 
7 Verify that the pool name was modified in the pool resource scripts: 
7a In iManager, select Clusters > My Clusters, then select the cluster that you want to manage. 
7b On the Cluster Manager page, click the name link of the pool resource. 
The pool resource name has not been modified by the pool rename. 
7c On the Resource Properties page, click the Scripts tab. 
7d Verify that the new pool name is used in the load, unload, and monitor scripts. 


Remember that the resource name and virtual server name are not modified by a pool 
rename. Do not modify those names in scripts. 


7d1 On the Load Script page, verify that the pool name was changed in the nss command. 
If you modify the load script, click Apply. 


exit_on_error nss /poolact=<new_pool_name> 
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For example: 
exit_on_error nss /poolact=PUSERS 


7d2 Click Unload Script, then verify that the pool name was changed in the nss command. 
Also check any custom commands where the volume name appears. If you modify the 
unload script, click Apply. 


exit_on_error nss /pooldeact=<new_pool_name> 
For example: 
exit_on_error nss /pooldeact=PUSERS 


7d3 Click Monitor Script, then verify that the pool name was changed in the status _fs 
command. Also check any custom commands where the pool name appears. If you 
modify the monitor script, click Apply. 


exit _on_error status_fs /dev/pool/<new_pool_name> /opt/novell/nss/mnt/ 
.pools/<new_pool_name> 


For example: 


exit _on_error status_fs /dev/pool/PUSERS /opt/novell/nss/mnt/.pools/ 
PUSERS 


7e Click Cancel to return to the Cluster Manager page, or click OK to apply any changes you 
made in the scripts. 
8 Bring the pool cluster resource online. At the command prompt, enter 


cluster online <resource_name> 
You can verify the online state by entering 
cluster status 


9 (Optional) Rename the pool cluster resource. For example, rename POOL1 SERVER as 
PUSERS_ SERVER. 


For instructions, see Section 10.15, “Renaming a Cluster Resource,” on page 227. 


Renaming a Shared Pool and Its Resource Objects 


To modify the pool name and its related resource objects, you can disable clustering for the pool, 
rename the pool, and then enable clustering for the renamed pool. Ensure that the pool is on the 
master node when you disable clustering. The Clusters plug-in in iManager must be used to disable 
and enable clustering for the pool. The rename procedure can be performed in iManager or NSSMU. 
1 Ensure that the pool cluster resource is running on the master node. 
If you need to migrate the resource: 
1a In iManager, select Clusters > My Clusters, then select the cluster that you want to manage. 


1b On the Cluster Manager page, select the check box next to the pool cluster resource, then 
click Migrate. 


1c Select the master node, then click OK. 
Wait for the resource to report a Running state before you continue. 


2 Take the pool cluster resource offline. On the Cluster Manager page, select the check box next 
to the pool cluster resource, then click Offline. 
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Wait for the resource to report an Offline state before you continue. 
3 In iManager, use the Clusters plug-in to delete the cluster resource for the shared pool: 
3a Select Clusters > My Clusters, then select the cluster. 
3b Select the Cluster Options tab. 
3c Select the check box next to the resource, then click Delete. 


3d When you are prompted to confirm the deletion, click OK to continue, or click Cancel to 
abort the deletion. 


3e Inthe Tree View in iManager, browse to verify that the Cluster Resource objects and related 
objects were removed from eDirectory. 


If necessary, you can manually delete the objects. In iManager, go to Directory 
Administration > Delete Objects, select the objects, then click OK. 


4 In iManager, re-create Storage objects for the pool and its volumes: 


These objects are needed by NSS when you rename the pool. They are also used by Novell 
Cluster Services when you re-create the resource. 


4a In iManager, select Storage > Pools, then select the cluster node where you want to rename 
the pool. 


4b Inthe Pools list, select the pool, then click Activate. 
4c Select the pool, then click Update eDirectory. 


This creates a Pool object in eDirectory with a name format of 
<server name> <pool name> POOL. 


4d Select Storage > Volumes. The server should still be selected. 
4e In the Volumes list, select the volume, then click Mount. 
4f Select the volume, then click Update eDirectory. 


This creates a Volume object in eDirectory with a name format of 
<server name>_< vol ume_name>. 


4g Repeat Step 4e through Step 4f for each volume in the pool. 
5 Rename the pool. 


The following rename procedure uses iManager. You can alternatively use NSSMU to rename 
the pool. 


5a In iManager, select Storage > Pools. The server should still be selected. 
5b In the Pools list, select the pool, then click Rename. 


5c Read the warning message that the pool’s volumes will be dismounted, then click OK to 
confirm that you want to rename the pool. 


If you rename a pool on a Linux server, NSS immediately dismounts its volumes. Click OK to 
rename the pool 
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5d In the Rename Pool dialog box, type the new name, then click Finish. 


Rename Pool 2) 
Enter a new name 


toz, Oto9, .| @ # $, %, & ( and) 
contain __ (multiple under 


5e Read the error message, then click OK to dismiss it. 


Error 23391 is EDIR OBJECT NOT FOUND. Typically, it means that the old Pool object has 
been removed successfully and can no longer be found. 


& Error: Unknown error with error code: 23391. 


Close 


5f View the renamed pool in the Pools list. 
After the rename, the pool is in a deactive state. Do not activate it on any nodes. 


If you activate it to verify that it is working as desired with the new name, deactivate it again 
before you continue. 
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Pools: Details: 
New... [PUSERS J| Name PUSERS 
_ Delete | Mount Point: Joptnovell/nss/mnt/.pools/PUSERS 
Rename... = cA 
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ANAE Number of Partitions: 0 
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6 Use the Clusters plug-in to cluster-enable the pool and create new resource objects with the new 
pool name. 


For detailed instructions, see Step 5 thru Step 18 in Section 12.5, “Cluster-Enabling an Existing 
NSS Pool and Its Volumes,” on page 253. 


6a In Roles and Tasks, select Clusters > My Clusters, then select the cluster. 

6b Select the Cluster Options tab. 

6c On the Cluster Options page, click the New link in the Cluster Objects toolbar. 

6d On the Resource Type page, select the Pool radio button, then click Next. 
The Cluster Pool Information page opens. 
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My Clusters > clus .ncs.novell > New Resource 


New Resource a 


Cluster Pool Information Cluster-enable a pool 


Pool Name: (| ) a 


Virtual Server Name: | | 
CIFS Server Name: 


IP Address | J 
Advertising Protocols: 

O arp 

O ars 

M! ncp 


CI online Resource after Creation 
Only select this option if you have verified that the pool is in an de-active state, otherwise the resource will go comatose during creation. 


1 Define Additional Properties 


<<Back | Next>» | Cancel | 


6e On the Cluster Pool Information page, specify the following resource setup information, then 
click Next: 


+ Pool name 
Browse to select the Pool Object of the pool. 
¢ Virtual server name 


A default name is suggested based on the pool name. You can specify a different name 
for the virtual server. 


+ IP address 
This is the IP address to use for the resource’s virtual server. 
+ Advertising protocols 
+ NCP (default, mandatory) 
+ AFP 
+ CIFS 


If you enable CIFS, a default name is suggested based on the NCP virtual server 
name. You can specify a different CIFS Server name. 


+ Deselect the Online Resource after Creation check box. 
+ Select the Define Additional Properties check box. 


My Clusters > clus1.ncs.novell > New Resource 


New Resource 
ft Cluster Pool Information Cluster-enable a pool. 


Pool Name: { avalon_POOLC1_POOL novell | 


Virtual Server Name: [CLUS1-POOLC1-SERVER] 
CIFS Server Name: | CLUS1-POOLC1-W 

IP Address: {10.10.1043 | 
Advertising Protocols: 

O arp 

O ars 

Vi ncp 


C] online Resource after Creation 
Only select this option if you have verified that the pool is in an de-active state, otherwise the resource will go comatose during creation. 


M) Define Additional Properties 


<<Back | Next>> | Cancel | 
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6f On the Resource Policies page, configure the resource policies for the start, failover, and 
failback modes, then click Next. 


See “Configuring the Start, Failover, and Failback Modes for Cluster Resources” on 
page 214. 


6g On the Resource Preferred Nodes page, assign the preferred nodes to use for the resource, 
then click Finish. 


See “Configuring Preferred Nodes and Node Failover Order for a Resource” on page 216. 


The pool cluster resource appears in the Cluster Objects list on the Cluster Options page, 
such aS POOL1_SERVER. 


6h (Optional) View and modify the resource properties. 
6i (Optional) Enable monitoring and configure the monitoring script. 


6j Bring the resource online. Select the Cluster Manager tab, select the check box next to the 
resource, then click Online. 


The pool is activated and its volumes are mounted on the primary preferred node that is 
configured for the pool cluster resource. 


If the pool goes comatose, take it offline, check that the pool is deactivated on the local 
server, then try again. 


Renaming a Shared Pool in a DST Cluster Resource 


The DST cluster resource is a pool cluster resource for the primary pool that has been modified to 
manage both the primary pool and secondary pool. When you use an NSS management tool to 
rename a cluster-enabled pool, it automatically changes the Pool object name in eDirectory; updates 
the pool name for its Volume objects; and updates the pool name that appears in the load, unload, 
and monitor scripts for the pool’s cluster resource. However, renaming a secondary pool cannot also 
update its name in the scripts for the primary pool’s resource, because the secondary pool's default 
Pool object and Volume object do not contain information about the primary pool. You must manually 
modify the scripts for the DST cluster resource after you rename a secondary pool. 


Renaming the shared primary pool or secondary pool in the DST cluster resource does not affect the 
settings that define the DST shadow relationship. 


The resource objects for a DST cluster resource are typically named when you cluster-enable the 
primary pool. Renaming a primary pool does not modify the names of the resource objects. To 
rename a primary pool name in a way that also modifies names of resource objects, you can disable 
clustering for the primary pool, rename the pool, and then enable clustering for the renamed pool. 
This process is described in “Renaming a Shared Pool and Its Resource Objects” (http:// 
www.novell.com/documentation/oes11/clus_admin_|Ix/data/rename_cluspool.html#b16vptoo). 


Afterwards, reconfigure the primary pool cluster resource to include the necessary commands for the 
secondary pool and the DST shadow volume pair, just as you did when you first set up the DST 
cluster resource. Because the primary volume name and secondary volume name are not affected by 
the pool rename, you do not need to modify the related commands in the /etc/opt /novell/ 
ncp2nss.conf file and /etc/opt /novell/ncpserv.conf file. 


To rename a shared pool in a DST cluster resource: 


1 Log in to the master node as the root user, then launch a terminal console. 


2 Ensure that the pool cluster resource is running on the master node. Enter 


cluster status 
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If you need to migrate the resource, enter the following at the command prompt: 
cluster migrate <resource_name> <master_node_name> 
3 Take the pool cluster resource offline. At the command prompt, enter 
cluster offline <resource_name> 
You can verify the offline state by entering 
cluster status 


4 Activate the pool to be renamed locally on the master node: 
4a At the command prompt, enter 


nssmu 


4b Select Pools to view a list of pools. The pool state is Deactive. 
4c Select the pool, then press F7 Activate. 
5 Rename the pool: 
5a On the NSSMU Pools page, select the pool. 
5b Press F6 Rename. 


5c Read the warning message that the pool’s volumes will be dismounted, then click OK to 
confirm that you want to rename the pool. 


5d Specify the new name, then press Enter. 
5e Read the error message, then press o (Ok) or press Enter to dismiss it. 


Error 23391 is EDIR OBJECT NOT FOUND. Typically, it means that the old Pool object has 
been removed successfully and can no longer be found. 


5f After the rename, the pool is in a deactive state. 
6 Press Esc twice to exit NSSMU. 
7 Verify that the pool name was modified in the pool resource scripts: 
7a In iManager, select Clusters > My Clusters, then select the cluster that you want to manage. 
7b On the Cluster Manager page, click the name link of the pool resource. 
Remember that the pool resource name has not been modified by the pool rename. 
7c On the Resource Properties page, click the Scripts tab. 
7d Verify that the new pool name is used in the load, unload, and monitor scripts. 
If you modified the secondary pool name, you must manually modify that line in the script. 


Remember that the resource name and virtual server name are not modified by a pool 
rename. Do not modify those names in scripts. 


7d1 On the Load Script page, verify that the pool name was changed in the nss command. 
If you modify the load script, click Apply. 


exit_on_error nss /poolact=<new_pool_name> 
For example: 
exit _on_error nss /poolact=PUSERS 


7d2 Click Unload Script, then verify that the pool name was changed in the nss command. 
Also check any custom commands where the volume name appears. If you modify the 
unload script, click Apply. 
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exit_on_error nss /pooldeact=<new_pool_name> 
For example: 
exit_on_error nss /pooldeact=PUSERS 


7d3 Click Monitor Script, then verify that the pool name was changed in the status fs 
command. Also check any custom commands where the pool name appears. If you 
modify the monitor script, click Apply. 


exit_on_error status_fs /dev/pool/<new_pool_name> /opt/novell/nss/mnt/ 
.pools/<new_pool_name> 


For example: 


exit _on_error status_fs /dev/pool/PUSERS /opt/novell/nss/mnt/.pools/ 
PUSERS 


7e Click Cancel to return to the Cluster Manager page, or click OK to apply any changes you 
made in the scripts. 


8 Bring the pool cluster resource online. At the command prompt, enter 
cluster online <resource_name> 
You can verify the online state by entering 


cluster status 


12.13 Renaming a Clustered NSS Volume 


When an NSS volume is in a cluster-enabled pool, special steps must be followed to rename it. 
Renaming the volume automatically changes the Volume object name, updates the volume 
information for the pool, and updates the volume name in the scripts for the pool cluster resource. 
Custom mount options are preserved in the ncpcon mount command. After the volume is renamed, 
the default mount point changes from /media/nss/<old_volume_name> to /media/nss/ 
<new_volume_name>. 


Because renaming requires that information is modified in eDirectory, you should rename the volume 
from the master node. NSS management tools require that the shared pool and volume are active 
locally on a cluster node that has its NCP Server object in the same context as the Pool object and 
Volume object of the volume you want to rename. The server must also be in the resource’s 
Preferred Nodes list to migrate to it. To view or modify the list, see Section 10.10, “Configuring 
Preferred Nodes and Node Failover Order for a Resource,” on page 216. 


Before you rename the volume, check the volume properties to ensure that the attribute Allow mount 
point to be renamed has been enabled. If the attribute is disabled, the volume name will be modified, 
and the mount point path is unchanged on the initial remount, making it appear that you have retained 
the old mount point path. However, for the shared volume, the default mount path of /media/nss/ 
<volume_name> is enforced with the new name on subsequent mounts. If your intent is to use a 
custom mount point path for a shared NSS volume, see Section 12.14, “Renaming the Mount Point 
Path for a Shared NSS Volume (Using a Custom Mount Point for a Shared NSS Volume),” on 

page 296. 


If the pool cluster resource manages multiple volumes, we recommend that you rename only one 
volume at a time. Verify that the renamed volume and pool cluster resource are working as expected 
before you attempt to rename another volume in the shared pool. 
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The NCP Server, Novell AFP, and Novell CIFS services are integrated with NSS and Cluster 
Services. The NCP, AFP, and CIFS file access continues to work after the volume is renamed. 
However, you must ensure that your users have the proper path information for the volume after it is 
renamed. If you have other protocols and services configured for the volume, you might need to re- 
configure them to work with the new volume name. 


After you rename the NSS volume, you must manually edit some lines in the resource scripts if you 
use a custom mount point path for the NSS volume. For more information, see Section 12.14, 
“Renaming the Mount Point Path for a Shared NSS Volume (Using a Custom Mount Point for a 
Shared NSS Volume),” on page 296. 


If the volume is used as the primary volume or secondary volume in a Dynamic Storage Technology 
resource script, special steps are required to remove references to the old names as a shadow 
volume pair. Some information must be removed manually on each node before you bring the 
modified resource online. 


You can use the procedures in the following sections to rename shared volumes: 


¢ Section 12.13.1, “Renaming a Shared NSS Volume with iManager,” on page 284 
¢ Section 12.13.2, “Renaming a Shared NSS Volume with NSSMU,” on page 288 
¢ Section 12.13.3, “Renaming a Shared NSS Volume in a DST Cluster Resource,” on page 292 


12.13.1 Renaming a Shared NSS Volume with iManager 


1 Ensure that the pool cluster resource is running on the master node. 
If you need to migrate the resource: 
1a In iManager, select Clusters > My Clusters, then select the cluster that you want to manage. 


1b On the Cluster Manager page, select the check box next to the pool cluster resource, then 
click Migrate. 


1c Select the master node, then click OK. 
Wait for the resource to report a Running state before you continue. 


2 Take the pool cluster resource offline. On the Cluster Manager page, select the check box next 
to the pool cluster resource, then click Offline. 


Wait for the resource to report an Offline state before you continue. 
3 Activate the pool locally on the master node: 
3a In iManager, select Storage > Pools. 
3b Browse to select the server where you want to activate the pool. 


3c In the Pools list, select the shared pool that contains the volume, then click Activate. 


Storage 


Pools Ea] 


Server: [avalon.novell | (al Fal 


Pools: Details: 


New... POOLD | Name: POOLF 
Delete POOLE H Joptinovellss/mnt/.pools 
Rename... Mount Point: POOLF 
Activate paisa sii ° | 
Deactivate Number of Partiti 1 
Increase size... Stat Active 
— Snapshot... | LSS Type: ZLSS 
Properties. Share State Sharable for Clustering 


vor e)a 
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4 Mount the volume locally on the master node: 


4a In iManager, select Storage > Volumes. 


The server field is automatically populated with the server you chose in the previous step. 


4b In the Volumes list, select the volume, then click Mount. 


Storage 


Volumes JEJ] 


Create and manage NSS volumes. You can also move and split volumes and activate or deactivate 
volumes. 


Server: [avalon novell ) ral 
Volumes: Details: 
Hew... [von [H] Name VOLF 
Delete VOLD SH Host Pool POOLF 
Rename... | VO F Owner: [Supervisor] 
Activate | | Mount Point: /mediainssVOLF 
Deactivate | | State: Active, Mounted 
Mount | Name Space(s: DOS, Mac, Unix, Long 
Dismount | Lookup Namespace: Long 
—— Quota: None 
1 Available Space: 495.95 MB 
Erepere =] Used Space 592 KB 
aes Purgeable Space 12 KB 
Update eDirectory | | Number of Objects: 33 


been enabled. If it is disabled, select it, then click OK. 


‘Storage > Volumes 


Volume Properties ? 


Properties: VOLI 


LTD Statistics \ Quota Usage 


Select the desired attributes for the volume. Once s 
the mount point's path, such as /mnt/nss/volumesA 
the volume name or its path 


Compression persists for the life of the volume. For Linux. specify 
mename. Enable the mount point to be renamed to allow updates to 


Backup C wigraton 
C compression C] modes Fie tistiweL 
C pata smreasing V) sange 
Number of shredding cycles: i C snapsnet 
M1 birecory qunas M1 user space quotas 
C Fush Fites immediately C user-level Transaction Moder 
Quota: CHEB 


Allow volume quota to growto the pool size 


Mount Point [/mediainssVOL1 ) Loobu Namespace: 
® Long 
OO mac 
O unix 


6 Rename the volume: 


6a In the Volumes list, select the volume, then click Rename. 


6b In the Rename Volume dialog box, specify the new name, then click OK. 


Rename Volume 
Enter anew name 

Volume names can have 2 to 15 characters and contain characters Ato Z, 0 to 9, _ !, @. #, $, %, & L and 
). Names cannot begin or end with the _ (underscore) character, nor contain __ (multiple underscores) 


Name: [USERS 


<<Back | Finish | Cancel | 


6c Wait for the volume to be automatically dismounted and remounted. When the page 
refreshes, the volume is mounted in the default mount point path /media/nss/ 
<new_volume_name>. 
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5 View the volume properties to ensure that the attribute Allow Mount Point to be Renamed has 
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Storage 


Volumes È 


Create and manage NSS volumes. You can also move and split volumes and activate or deactivate 


volumes. 
Server: avalon. novell T fal 
Volumes: Details: 
New. (S| Name: USERS 
Delete VOLD Host Pool POOLF 
Rename. VOLD-SH Owner: [Supervisor] 
Activate Mount Point: imedia/nss/USERS 
Deactivate | State Active, Mounted 
‘Mount Name Spaceis) DOS, Mac, Unix, Long 
Dismount | Lookup Namespace: Long 
E Quota None 
t Available Space 495.95 MB 
EE] Used Space 592 KB 
Hnr Quote. | | Purgeable Space: 12 KB 
Update eDirectory | | Number of Objects: 33 


If you try to force the page to refresh before the eDirectory changes have been 
synchronized, you might get an Error 601 eDirectory error. The error condition is temporary 
and should not prevent the transaction from completing successfully. 


Ż Error: -601 - eDirectory Error - Object does not exist. 


Close 


7 Dismount the volume: 
7a Inthe Volumes list, select the volume, then click Dismount. 


7b Read the warning message that open files will be closed by the action, then click OK to 
confirm the dismount. 


This operation will cause all of the open files on the volume(s) to be 
closed. 


(ene) 


7c Wait for the volume state to change to Deactive, Not Mounted, then continue. 


Storage 


Volumes iz] 


Create and manage NSS volumes, You can also move and split volumes and activate or deactivate 
volumes 


Server: [avalon novell | AA 
Volumes: Details: 
New... | | Name USERS 
pasem] VOLD 
Host Pool POOLF 
aaa VOLD_SH ext rae : 
Owner [Supervisor] 
Acthvate Mount Point: 
Deactive, Not Mounted 
Mount State: eactive, ounte: 
a Name Space(s) 
Nove ] Lookup Namespace: Long 
ae Quota 
Properties... | Available Space: 
User Quotas... | Used Space: 
Update eirectany| | Puigeable Space 


8 Deactivate the pool: 
8a In iManager, select Storage > Pools. 
8b In the Pools list, select the pool, then click Deactivate. 


8c Read the warning message that the pool’s volumes will be dismounted, then click OK to 
continue. 
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8d 


9 Verify that the volume name was updated in the scripts for its pool cluster resource: 


9a 
9b 


9c 


9d 


9e 


This operation will cause open files to be closed for all of the 
volumes on the pool(s). 


Cancel 


storage 


Pools 


When the page refreshes, 


verify that the pool state is Deactive. 


2 


Create and manage storage pools. Increase the storage space assigned to the pool to meet demand 
Use snapshots to preserve point-in-time views of data pools and to support data recovery and backup 


Server: [avalon novell EGI] 


Pools: Details: 


POOLD [] Name 
| POOLE 


POOLF | Mount Point: 


Partitions: 

Number of Partitions: 
State 

LSS Type 


Properties Share State 


Update eDirectory | Volumes: 


Number of Volumes: 


Devices: 


Number of Devices: 


POOLF 
/opt/novell/nss/mnt/.pools: 
/POOLF 

l JE 

0 

Deactive 

l EAE 

0 

[sat E] 

1 


In iManager, select Clusters > My Clusters, then select the cluster that you want to manage. 


On the Cluster Manager page or Cluster Options page, click the name of the pool cluster 
resource to open the resource properties. 


Click the Scripts tab. 


My Clusters > cl134ncs novell > POOLF_SERVER 


& POOLF_SERVER 


Policies | Monitoring | Preferred Nodes 


i) 


Protocols \ Business Continuity 


Load Script | Unload Script | Monitor Script 


View or edit the load script for this cluster resource. Changes other than business continuity changes made to 


a resource will not take affect until the resource is reloaded. 


Script: 


#!/bin/bash 

/opt /novell /nes/Lib/nesfunes 
exit_on_error nss /poolact=POOLF 
exit_on_error ncpcon mount USERS=252 


exit_on_error add_secondary_ipaddress 137. 65. 67.244 


exit_on_error ncpcon bind --ncpservername=CL134-POOLF-SERVER --ipaddress 


exit 0 


— — —  ć — ae 


Timeout: (6 | (Mnutes > | 


OK | _ Cancel | __ Apy | 


On the Load Script page, verify that the volume name was changed in the ncpcon mount 


command. Also check any custom commands where the volume name appears. If you 


modify the load script, click Apply. 


exit_on_error ncpcon mount <new_volume_name>=<volume_id> 


For example: 


exit_on_error ncpcon mount USERS=252 


Click Unload Script, then check any custom commands where the volume name appears. If 
you modify the unload script, click Apply. 


The unload script does not contain any default volume commands. 


Configuring and Managing Cluster Resources for Shared NSS Pools and Volumes 


287 


9f Click Monitor Script, then verify that the volume name was changed in the ncpcon volume 
command. Also check any custom commands where the volume name appears. If you 
modify the monitor script, click Apply. 


exit_on_error ncpcon volume <new_volume_name> 
For example: 
exit_on_error ncpcon volume USERS 


9g Click Cancel to return to the Cluster Manager page, or click OK to apply any changes you 
made in the scripts. 


10 Bring the pool cluster resource online: 
10a In iManager, select Clusters > My Clusters, then select the cluster that you want to manage. 


10b On the Cluster Manager page, select the check box next to the pool cluster resource, then 
click Online. 


The resource is brought online on a node in its Preferred Nodes list, according to 
availability. Wait for the resource to report a Running state before you continue. 


12.13.2 Renaming a Shared NSS Volume with NSSMU 


1 Log in to the master node as the root user, then launch a terminal console. 


2 Ensure that the pool cluster resource is running on the master node. Enter 
cluster status 
If you need to migrate the resource, enter the following at the command prompt: 
cluster migrate <resource_ name> <master node_name> 

3 Take the pool cluster resource offline. At the command prompt, enter 
cluster offline <resource_name> 
You can verify the offline state by entering 
cluster status 


4 Activate the pool locally on the master node: 


4a At the command prompt, enter 
nssmu 


4b On the NSSMU Main Menu, select Pools, then press Enter. 
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4c On the Pools page, select the pool, then press F7 Activate. 


4d Press Esc to return to the NSSMU Main Menu. 

5 Mount the volume locally on the master node: 
5a On the NSSMU Main Menu, select Volumes, then press Enter. 
5b On the Volumes page, select the volume, then press F7 Mount. 


h F7=Dismount = F8=More 


6 On the Volumes page, view the volume properties to ensure that the attribute Allow renaming 
mount point has been enabled. If it is disabled, select the attribute value, press y (Yes) to enable 
it, then select Apply and press Enter. 


7 Rename the volume: 
7a On the Volumes page, select the mounted NSS volume that you want to rename. 
7b Press F3 Rename, specify the new name, then press Enter. 
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‘Ins=Create Del=Delete F3 me FS=Refresh F7=Dismount = = F8=More 


7c Wait for the volume to be automatically dismounted and remounted. When the page 
refreshes, the volume is mounted in the default mount point path /media/nss/ 
<new_volume_name>. 


Ins=Create Del=Delete F3=Rename FS=Refresh F7=Dismount 


If you try to force the page to refresh before the eDirectory changes have been 
synchronized, you might get an eDirectory error. The error condition is temporary and 
should not prevent the transaction from completing successfully. 


8 Dismount the volume: 
8a On the NSSMU Volumes page, select the volume, press F7 Dismount. 


8b Read the warning message that open files will be closed by the action, then press y (Yes) to 
confirm the dismount. 


8c Press Esc to return to the NSSMU Main Menu. 
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9 Deactivate the pool on the cluster node: 
9a On the NSSMU Main Menu, select Pools, then press Enter. 
9b On the Pools page, select the pool, then press F7 Deactivate. 


9c Read the warning message that the pool’s volumes will be dismounted, then press y (Yes) 
to confirm the deactivation. 


‘=Deactivate S=Segments 


9d When the page refreshes, verify that the pool state is Deactive. 


9e Press Esc twice to exit NSSMU. 
10 Verify that the volume name was updated in the scripts for its pool cluster resource: 
10a In iManager, select Clusters > My Clusters, then select the cluster that you want to manage. 


10b On the Cluster Manager page or Cluster Options page, click the name of the pool cluster 
resource to open the resource properties. 


10c Click the Scripts tab. 


My Clusters > cl134.ncs.novell > POOLF_SERVER 


& POOLF_SERVER 


el 


Policies \ Monitoring | Preferred Nodes Protocols | Business Continuity | 
Load Script | Unload Script | Monitor Script 


View or edit the load script for this cluster resource. Changes other than business continuity changes made to 
a resource will not take affect until the resource is reloaded 


Script: 

#!/bin/bash 

. /opt/novell /nes/Lib/nesfuncs 

exit_on_error nss /poolact=POOLF 

exit_on_error ncpcon mount USERS=252 

exit_on_error add_secondary_ipaddress 137.65. 67.244 


exit_on_error ncpcon bind --ncpservername=CL134-POOLF-SERVER --ipaddress= 
exit 0 
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10d On the Load Script page, verify that the volume name was changed in the ncpcon mount 
command. Also check any custom commands where the volume name appears. If you 
modify the load script, click Apply. 


exit_on_error ncpcon mount <new_volume_name>=<volume_id> 
For example: 
exit_on_error ncpcon mount USERS=252 
10e Click Unload Script, then check any custom commands where the volume name appears. If 
you modify the unload script, click Apply. 
The unload script does not contain any default volume commands. 


10f Click Monitor Script, then verify that the volume name was changed in the ncpcon volume 
command. Also check any custom commands where the volume name appears. If you 
modify the monitor script, click Apply. 


exit_on_error ncpcon volume <new_volume_name> 
For example: 
exit_on_error ncpcon volume USERS 


10g Click Cancel to return to the Cluster Manager page, or click OK to apply any changes you 
made in the scripts. 


11 Bring the pool cluster resource online. At the command prompt, enter 
cluster online <resource_name> 
You can verify the online state by entering 


cluster status 


Renaming a Shared NSS Volume in a DST Cluster Resource 


A Dynamic Storage Technology (DST) shadow volume pair consists of two NSS volumes that are 
managed together. Users see a single merged view of the data stored on the two volumes. This 
section assumes some understanding of how clustered DST volumes are configured. For more 
information, see “Configuring DST Shadow Volume Pairs with Novell Cluster Services” in the OES 11 
SP3: Dynamic Storage Technology Administration Guide. 


The DST cluster resource is a pool cluster resource for the primary pool that has been modified to 
manage both the primary pool and secondary pool. Renaming a volume changes the Volume object 
name, updates the volume information for the pool, and updates the volume name in its pool’s 
resource scripts. However, a volume rename for a secondary volume cannot also update the scripts 
for the primary pool’s resource because its default Pool object and Volume object do not contain 
information about the primary pool. You must manually modify the scripts for the DST cluster 
resource after you rename a secondary volume. 


When you rename a shared volume in a DST cluster resource, you also affect the settings that define 
the DST shadow relationship. The DST settings are not automatically updated when you rename the 
primary volume or secondary volume. 


292 OES 11 SP3: Novell Cluster Services for Linux Administration Guide 


The DST relationship between the primary volume and secondary volume is defined by the ncpcon 
mount Command in the DST cluster resource. DST settings that use the volume names are found in 
the following files that exist on each cluster node. You must manually remove the information on each 
node. 


¢ /etc/opt/novell/ncp2nss.conf 


This file contains the EXCLUDE_VOLUME <secondary_volume_name> entry that prevents the 
secondary volume from being mounted in NCP. For example: 


EXCLUDE VOLUME VOLD 


The rename function does not remove this entry from the file. Cluster Services also does not 
remove the entry from the file. After the volume is renamed, when you bring the resource online 
on a node, a new entry is made for the secondary volume with the new name. You must 
manually remove the entry for the old volume name from the file on each node as part of the 
rename process. 


+ /etc/opt/novell/ncpserv.conf 


This file contains the shadow volume entry. For example: 
SHADOW VOLUME HOME /media/nss/VOLD 


After you rename the primary volume or secondary volume, a new entry is made in the file with 
the new primary volume name or secondary volume path. You must remove the entry for the 
DST volume from the file as part of the rename process. 


After you rename the volume, new entries are added to the ncp2nss.conf file and ncpserv. conf file 
on the node where you bring the modified resource online. 


To rename a volume in a shared DST shadow volume pair: 


1 Log in to the master node as the root user, then launch a terminal console. 


2 Ensure that the DST cluster resource is running on the master node. Enter 
cluster status 
If you need to migrate the resource, enter the following at the command prompt: 
cluster migrate <resource_name> <master_ node_name> 

3 Take the DST cluster resource offline. At the command prompt, enter 
cluster offline <resource_name> 
You can verify the offline state by entering 
cluster status 


4 Open the /etc/opt/novell/ncpserv.conf file in a text editor, remove the entry for the DST 
shadow volume pair, then save the file. Repeat this task for every node in the cluster. 


SHADOW VOLUME <primary_volume_name> /media/nss/<secondary_volume_name> 
For example: 
SHADOW VOLUME HOME /media/nss/VOLD 


5 If you are renaming the secondary volume, open the /etc/opt/novell/ncp2nss.conf file ina 
text editor, remove the EXCLUDE_VOLUME entry for the volume, then save the file. Repeat this 
task for every node in the cluster. 
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EXCLUDE VOLUME <secondary_volume_name> 
For example: 
EXCLUDE VOLUME VOLD 


6 Activate the pool locally on the master node: 


6a At the command prompt, enter 
nssmu 


6b On the NSSMU Main Menu, select Pools, then press Enter. 


6c On the Pools page, select the pool that contains the volume you want to rename, then press 
F7 Activate. 


6d Press Esc to return to the NSSMU Main Menu. 

7 Mount the volume to be renamed locally on the master node: 
7a Onthe NSSMU Main Menu, select Volumes, then press Enter. 
7b On the Volumes page, select the volume, then press F7 Mount. 


8 On the Volumes page, view the volume properties to ensure that the attribute Allow renaming 
the mount point has been enabled. If it is disabled, select the attribute value, press y (Yes) to 
enable it, then select Apply and press Enter. 


9 Rename the volume: 
9a On the Volumes page, select the mounted NSS volume that you want to rename. 
9b Press F3 Rename, specify the new name, then press Enter. 


9c Wait for the volume to be automatically dismounted and remounted. When the page 
refreshes, the volume is mounted in the default mount point path /media/nss/ 
<new_volume_name>. 


If you try to force the page to refresh before the eDirectory changes have been 
synchronized, you might get an eDirectory error. The error condition is temporary and 
should not prevent the transaction from completing successfully. 


10 Dismount the volume: 
10a On the NSSMU Volumes page, select the volume, then press F7 Dismount. 


10b Read the warning message that open files will be closed by the action, then press y (Yes) to 
confirm the dismount. 


10c Press Esc to return to the NSSMU Main Menu. 

11 Deactivate the pool that you activated in Step 6: 
11a On the NSSMU Main Menu, select Pools, then press Enter. 
11b On the Pools page, select the pool, then press F7 Deactivate. 


11c Read the warning message that the pool’s volumes will be dismounted, then press y (Yes) 
to confirm the deactivation. 


11d When the page refreshes, verify that the pool state is Deactive. 
1le Press Esc twice to exit NSSMU. 
12 Modify the volume name in the scripts for its DST cluster resource: 
12a In iManager, select Clusters > My Clusters, then select the cluster that you want to manage. 


12b On the Cluster Manager page or Cluster Options page, click the name of the pool cluster 
resource to open the resource properties. 
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12c Click the Scripts tab. 


12d On the Load Script page, modify the volume name in the ncpcon mount command. Also 
check any custom commands where the volume name appears. If you modify the load 
script, click Apply. 


exit_on_error ncpcon mount 
<primary_volume_name>=<volume_id>,shadowvolume=<secondary_volume_name> 


For example, if you rename the primary volume from HOME to USERS, and the secondary 
volume is VOLD, change this line 


exit_on_error ncpcon mount HOME=252, shadowvolume=VOLD 
to this: 


exit_on_error ncpcon mount USERS=252,shadowvolume=VOLD 


If you rename the secondary volume name from VOLD to HOME_SH, and the primary volume 


is named HOME, change this line 
exit_on_error ncpcon mount HOME=252,shadowvolume=VOLD 
to this: 


exit_on_error ncpcon mount HOME=252,shadowvolume=HOME_SH 


12e Click Unload Script, then check any custom commands where the volume name appears. If 


you modify the unload script, click Apply. 
The unload script does not contain any default volume commands. 


12f If you renamed the primary volume, click Monitor Script, then modify the primary volume 


name in the ncpcon volume command. The secondary volume is not monitored because it 


is hidden from NCP. If you modify the monitor script, click Apply. 

exit_on_error ncpcon volume <new primary _volume_name> 

For example, if you rename the primary volume from HOME to USERS, change this line 
exit_on_error ncpcon volume HOME 

to this: 


exit_on_error ncpcon volume USERS 


12g Click Cancel to return to the Cluster Manager page, or click OK to apply any changes you 


made in the scripts. 


Bring the pool cluster resource online. At the command prompt, enter 
cluster online <resource_name> 
You can verify the online state by entering 


cluster status 


The first time that the modified DST cluster resource is brought online on a node, the new entries 


are added to the ncp2nss.conf file and ncpserv.conf file. 
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Renaming the Mount Point Path for a Shared NSS 
Volume (Using a Custom Mount Point for a Shared 
NSS Volume) 


This section describes how to modify the load and unload scripts to specify a custom mount point for 
a clustered NSS volume. The NSS volume attribute Allow renaming mount point must be enabled. 


For local NSS volumes, the Linux mount point for the device that contains the volume is stored in the 
/etc/fstab file, and the NCP mount point for the volume is stored in the /etc/opt/nove11/ 
ncpserv. conf file. By design, clustered NSS volumes do not have entries in these files. The 
mounting and dismounting of clustered volumes is controlled by the load and unload scripts. The 
mount location is assumed to be the default /media/nss/<volume_name>. 


In an NSS pool cluster resource’s load script, the pool activation command automatically mounts the 
NSS volume in Linux at the default mount point /media/nss/<volume_name>. The ncpcon mount 
command creates an NCP volume instance for the NSS volume and also assumes the default mount 
point. 


If you enable the NSS volume attribute Allow renaming mount point, you can modify the load and 
unload scripts to mount and dismount the NSS volume and NCP instance of the volume in a custom 
location. However, you must use a Linux command to dismount the volume from the default location, 
then mount it in the new location. Use the path option in the nepcon mount command to specify the 
preferred mount point path. Before you bring the resource online by using the modified load script, the 
custom mount point path must be created manually on all nodes where the resource is allowed to 
load. You can alternatively add the Linux mkdir -p command before the Linux mount command to 
create the path. 


After you modify the load and unload scripts to use a custom mount location, you should use the 
cluster online command to mount the volume, and use the cluster offline command to 
dismount the volume. If you need to mount the volume locally, do not use NSSMU or the Storage 
plug-in in iManager to mount or dismount the volume. These tools rely on information in /etc/fstab 
file to provide the preferred mount point location, but the clustered volume has no entry there. 


+ To mount the volume locally, take the resource offline, activate the pool, then use the Linux 
mount Command to mount it in Linux and the ncpcon mount command to mount it for NCP. 
Ensure that you specify the custom mount point location in the commands as you do in the load 
script. 


¢ To dismount the volume locally, use the ncpcon dismount command to dismount the volume 
from NCP, then use the Linux umount command to dismount the volume from Linux, then 
deactivate the pool. Bring the resource online to mount the volume for the cluster. 
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The following sample values are used in the NSS pool cluster resource scripts in the following 
procedure. Replace the values with the actual values for your own clustered pool and volume. 


Variable Sample Value 

Cluster resource’s virtual server name CLUS1-POOL-D-SERVER 
Resource IP address 10.10.10.44 

Device Idev/sdd 

Pool name POOL D 

Volume name VOL _D 

Volume ID 252 (valid values are 0 to 254) 
Advertising protocols enabled for the resource NCP (You can add others.) 
Default mount point location /media/nss/VOL_D 

New mount point location /usr/novell/nss/VOL_D 


To rename the mount point path for a clustered NSS volume to use a custom mount point location: 
1 Verify that the NSS volume attribute Allow renaming mount point is enabled to allow the mount 
point to be renamed. The attribute is enabled by default. 
1a Log in as the root user to the server where the NSS pool cluster resource is online. 
1b Open a terminal console, then launch NSSMU: 


nssmu 
1c Inthe NSSMU Main Menu, select Volumes, then press Enter. 


1d Select the volume in the Volumes list, then press Enter to open its Volume Properties page. 


1e Use the Down arrow to navigate to and select the value for the Allow renaming mount point 
attribute. 


Immediately: 


nung mount 
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1f If the value is set to no, press y (Yes) to enable it. 
1g Use the arrow keys to navigate to and select Apply, then press Enter. 
1h Press Esc twice to exit NSSMU. 
2 Open Novell iManager in a web browser, then log in as a cluster administrator user. 


3 In Roles and Tasks, select Clusters > My Clusters, select the cluster, then click the Cluster 
Manager tab. 


4 On the Cluster Manager page, select the resource’s name link to open its Cluster Properties 
page, then click the Scripts tab. 


The Scripts tab automatically displays the load script. 

5 On the Load Scripts page, view the default load script for the NSS pool cluster resource. 
The following sample load script is enabled for NCP as an advertising protocol. The pool name is 
POOL_D and the volume name is VOL_D. 

#!/bin/bash 
. /opt/novell/ncs/1ib/nesfuncs 
exit_on_error nss /poolact=POOL_D 
exit_on_error ncpcon mount VOL D=252 
exit_on_error add_secondary ipaddress 10.10.10.44 
exit_on_error ncpcon bind --ncpservername=CLUS1-POOL-D-SERVER --ipaddress=10.10.10.44 
exit 0 
6 Modify the load script to specify the new mount point path: 
6a After the pool activation command, add a Linux umount command to dismount the NSS 
volume from Linux. 


# unmount the NSS volume from Linux (currently mounted at /media/nss/volname) 
ignore error umount -t nssvol VOL D 


The pool activation automatically mounts the volume on Linux at /media/nss/ 
<volume_name>. You must dismount the volume from Linux before you can remount it for 
Linux at the new location. 


6b After the umount command, add a Linux mkdir command to create the new mount point 
path on nodes if it does not exist. 


# create the custom mount point path if it does not exist on the node 
ignore error mkdir -p /usr/novell/nss/VOL_D 


You can alternatively create the new path by using the mkdir command in a terminal 
console on each node where the resource is allowed to load. If the master node is not the 
most preferred node, ensure that you make the path before you bring the resource online. 


6c After the mkdir command, add a Linux mount command to mount the NSS volume at the 
new mount point path. 


# mount the NSS volume using the Linux mount command 
exit_on_error mount -t nssvol VOL_D /usr/novell/nss/VOL_D -o name=VOL_D 


6d Add the path option to the ncpcon mount command in order to specify the custom mount 
point path. 


# add the path command to create the NCP instance at the new location 
exit _on_error ncpcon mount VOL_D=252,path=/usr/novell/nss/VOL_D 
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6e Review the modified load script to ensure the correct order of commands: 


#!/bin/bash 
. /opt/novell/nes/lib/nesfuncs 
exit_on_error nss /poolact=POOL_D 


unmount the NSS volume from Linux (currently mounted at /media/nss/volname) 
ignore error umount -t nssvol VOL D 


create the custom mount point path if it does not exist on the node 
ignore_error mkdir -p /usr/novell/nss/VOL_D 


mount the NSS volume using the Linux mount command 
exit_on_error mount -t nssvol VOL_D /usr/novell/nss/VOL_D -o name=VOL_D 


add the path to create the NCP instance at the new location 
exit_on_error ncpcon mount VOL_D=252,path=/usr/novell/nss/VOL_D 


exit_on_error add_secondary_ipaddress 10.10.10.44 
exit_on_error ncpcon bind --ncpservername=CLUS1-POOL-D-SERVER --ipaddress=10.10.10.44 


exit 0 


6f Click Apply. 
Wait for the page to refresh before you continue. 
7 On the Scripts tab, click Unload Script. 
8 On the Unload Script page, view the default unload script for the NSS pool cluster resource. 
The following sample unload script is enabled for NCP as an advertising protocol. The pool 
name is POOL_D and the volume name is VOL_D. 


#!/bin/bash 
. /opt/novell/ncs/lib/nesfuncs 


ignore _error ncpcon unbind --ncpservername=CLUS1-POOL-D-SERVER --ipaddress=10.10.10.44 
ignore_error del_secondary_ipaddress 10.10.10.44 
ignore error nss /pooldeact=POOL_D 


exit 0 


9 Modify the unload script to explicitly dismount the volume and NCP instance from the custom 
mount point location: 


9a After the del_secondary_ipaddress command, add an ncpcon dismount command to 
dismount the NCP instance from the new mount point location. 


# dismount the NSS volume from NCP 
ignore _error ncpcon dismount VOL_D 


9b After the ncpcon dismount command, add a Linux umount command to unmount the NSS 


volume from Linux. 


# unmount the NSS volume from Linux 
ignore error umount -t nssvol VOL D 
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9c Review the modified unload script to ensure the correct order of commands: 


#!/bin/bash 
. /opt/novell/nes/lib/nesfuncs 


ignore_error ncpcon unbind --ncpservername=CLUS1-POOL-D-SERVER --ipaddress=10.10.10.44 
ignore_error del_secondary_ipaddress 10.10.10.44 


# dismount the NSS volume from NCP 
ignore error ncpcon dismount VOL D 


# unmount the NSS volume from Linux 
ignore error umount -t nssvol VOL D 


ignore error nss /pooldeact=POOL_D 
exit 0 
9d Click Apply. 
Wait for the page to refresh before you continue. 
(Optional) On the Scripts page, click Monitor Script, then view the monitor script. 
No changes are required for the monitor script. 
At the bottom of the Scripts page, click OK to save your changes and close the Properties page. 
The changes do not take effect until the resource is taken offline and brought online. 


Take the resource offline, then bring the resource online in order for the script changes to take 
effect. 


12a On the Cluster Manager page, select the check box next to the resource, then click Offline. 
Wait for the status to report that it is offline, then continue. 


12b Select the check box next to the resource, then click Online. 
12c Verify that the resource comes online and reports a Running state. 


If the resource goes into a Comatose state, there might be a mistake in the lines you added 
or modified in the script. Take the resource offline, then go back to correct the scripts, and 
try to bring it online again. 


In NSSMU, verify that the new mount point is used when the pool cluster resource is brought 
online: 


13a Log in as the root user to the node that is hosting the resource, then start NSSMU by 
entering: 


nssmu 


13b From the NSSMU Main Menu, select Volumes, then press Enter. 


13c In the Volumes list, select the clustered NSS volume. 
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13d View the volume details to verify that the mount point has changed. 


For example, the mount point in this example should display /usr/novell/nss/VOL_D. 


Long 


13e Press Escape twice to exit NSSMU. 


14 In Novell Remote Manager, verify that the new mount point is used for the NSS volume and its 
NCP instance when the pool cluster resource is brought online: 


14a In a web browser, launch Novell Remote Manager for the node that is hosting the resource, 


14b 


14c 


then log in as the root user. 


On the File System Management page, view the mount information for the NSS volume 
under File Systems, and view its NCP instance under NCP Volumes. Note that both 
volumes are mounted at the new mount point location /usr/novell/nss/VOL_D. 


a OE 


= Diagnose File System Management Be 
B View File System 
— File — Lo. File Systems 
ee tation Mountes eve Mount Location 
General File Inventory 
NCP Volume inventor ® rootfs L (43% free) 
Dynamic Storage Technology ® udev idev (99% free) 
Options tmpts idevishm 
= Manage Linux idevisda3 . 
proc proc 
® Manage Hardware systs Isys 
© Use Group Operations devpts Idewpts 
B Manage NCP Services debugfs /sys/kernel/debu 
View Inventory Reports ®© /devisdal boot (78% free) 
View Trustee Reports fusectl /sysitsfuse/connections 
Manage Shares securityts /sys/kernel/security 
Banaga Server admints Jadmin 
Manage Connections none Iproc/sysits/bintmt_misc 
a none Narlibintp/proc 
ew istics 
View Diagnostic Information ® admin nadan (100% free) 
/dew/pool/POOL_D /opt/novell/nss/mnt/.pools/POOL_D 
novis Nat/opt/inovell/ncimnt 
gvis-fuse-daemon /root/.qvis 
dew/s0 /media/OES11-SP1-addon-x86_6400361__(0% free: 
@®VOL_D /ust/novell/nss/VOL_D (99% free) 
@sys Just/novell/sys 
i) ADMIN /-admin 
@VOL_D /ust/novell/nss/VOL_D 
Exit Novell Remote Manager. 
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15 Open a Linux terminal console as the root user, then list the files in the new mount point 
location. 


11 /usr/novell/nss/VOL_D 


For example, the following is the list for anew NSS volume. You should see the default 
~DFSINFO.8-P file and the hidden . NETWARE directory. If AFP is enabled as an advertising 
protocol, the DESKTOP . AFP directory is also present. For an existing volume that contained user 
data, you should also see additional directories listed. 


avalon:~/Desktop # LL /usr/novell/nss/VOL_D 

total 12 

drwxrwxrwx 1 root root © Aug 22 22:16 GESKTORNARE 
-r--r--r-- 1 root root 24 Aug 22 22:16 ~DFSINFO.8-P 
d--x--x--x 1 root root © Aug 23 00:00 ._NETWARE 
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Volume 


The load script for an NSS volume assumes that the default name space of LONG is used when 
mounting the clustered NSS volume. If you change the name space setting for shared volume by 
using NSSMU or the Storage plug-in for iManager, you must modify the load script for the pool cluster 
resource to add the name space to the ncpcon mount command for the volume. See Section 12.6.3, 
“Specifying Custom Mount Options,” on page 261. 

1 Open Novell iManager in a web browser, then log in as a cluster administrator user. 


2 In Roles and Tasks, select Clusters > My Clusters, select the cluster, then click the Cluster 
Manager tab. 


3 Modify the mount point path value in the load scripts for the pool cluster resource: 


3a On the Cluster Manager page, select the resource’s name link to open its Cluster Properties 
page, then click the Scripts tab. 


The Scripts tab automatically displays the load script. 
3b Modify the load script: 


3b1 In the load script, add the /opt=ns=<1long|unix|dos|mac> option for the ncpcon 
mount command and specify the custom name space to use for the volume. For 
example: 


exit _on_error ncpcon mount /opt=ns=unix USERS=254 


3b2 Click Apply, then click OK to acknowledge the confirmation message. 
3c At the bottom of the page, click OK to close the Properties page and save your changes. 
The changes do not take effect until the resource is taken offline and brought online. 


4 Take the resource offline, and bring the resource online in order for the script changes to take 
effect. 


4a On the Cluster Manager page, select the check box next to the resource, then click Offline. 
Wait for the status to report that it is offline, then continue. 


4b Select the check box next to the resource, then click Online. 
4c Verify that the resource comes online and reports a Running state. 


If the resource goes into a Comatose state, it is probably because you made a mistake in 
the lines you added or modified in the script. Take the resource offline, then go back to 
correct the scripts, and try to bring it online again. 
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Adding a Volume to a Clustered Pool 


When you use NSSMU, the Storage plug-in for iManager, or the NLVM command line interface to add 
an NSS volume to a clustered pool, a mount command is automatically added to the load script for 
the pool cluster resource. Offline and online the primary pool cluster resource to apply the modified 
load script. 


If you add a volume to the primary pool for a clustered DST shadow volume, the mount command is 
added twice in the primary pool's cluster load script, once after the primary pool’s activation 
command and once after the secondary pool’s activation command. You must manually delete the 
instance that occurs after the secondary pool’s activation, then offline and online the primary pool 
cluster resource to apply the modified load script. 

1 In iManager under Roles and Tasks, select Storage > Volumes. 

2 Browse to select the Cluster object of the cluster where the pool is currently online. 

You can also select the server where the pool cluster resource is currently mounted. 
3 Click New to open the New Volume wizard, then create the new volume on the shared pool. 


See “Creating Unencrypted NSS Volumes” in the OES 11 SP3: NSS File System Administration 
Guide for Linux. 


4 In Roles and Tasks, select Clusters > My Clusters, then select the cluster you want to manage. 


If the cluster you want to manage is not in the list, you can add it. Click Add, browse to locate 
and select the Cluster object of the cluster, then click OK. 


5 If you added a volume to the primary pool for a DST shadow volume, modify the load script to 
remove the instance of the mount command that immediately follows the pool activation line for 
the secondary pool. 


5a Select Cluster Options. 


5b Click the name link of the pool cluster resource to open its Properties page, then click the 
Scripts tab. 


5c In the load script, delete the mount command for the new volume that follows the pool 
activation command for the secondary pool. 


5d Click ox to save your changes. 
5e Click Cluster Manager to return to the Cluster Manager page. 


6 On the Cluster Manager page in the Cluster Resource list, select the check box next to the pool 
cluster resource, then click Offline to take the resource offline. 


Wait for the resource to report itself as Offline before you continue. 


7 Inthe Cluster Resource list, select the check box next to the pool cluster resource, then click 
Online to bring the resource online. 


This applies the modified load script, which mounts the newly created volume. 
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Changing an Assigned Volume ID 


Novell Cluster Services supports NCP client access to cluster-enabled NSS volumes by using a 
unique volume ID to mount the volume in the cluster. The volume ID is used by an NCP client only for 
automatic reconnects to the volume after failover or migration of a cluster resource. 


Valid volume ID values are 0 to 254 (up to 255 mounted volumes per server). When you create a new 
volume on a cluster-enabled pool, Cluster Services automatically assigns it a volume ID that is 
unique in the entire cluster and writes the value to the cluster resource load script for the pool. Values 
start at 254 for the first volume in the cluster and decrease for each new volume. You can view the 
volume IDs assigned on a node by using the ncpcon volumes command. 


In older operating systems, there was a mounted volume limit of 64 volumes (values 0 to 63). Some 
older applications might have hardcoded the old maximum limit of 64 mounted volumes, and might 
not be able to handle volume IDs greater than 63. You can use the Clusters plug-in to iManager to 
modify the volume ID in the scripts for a given cluster resource in order to specify a value that works 
for the application. 


Changing the volume ID does not affect the ability to log in to, back up, or access the data. However, 
there is a brief disruption of service as the cluster resource is offlined and onlined to apply the script 
changes. If you modify the volume ID for a volume in the cluster resource scripts, ensure that you do 
the following: 


© Volume IDs that you manually assign must be unique across every volume on all servers in 
cluster. 


After the value is changed, you must offline and online the cluster resource for the volume in 
order to mount the volume with its new volume ID. 


O After the volume is mounted with its new ID, the clients must log out and log in to the volume in 
order to reconnect to the volume with its new volume ID. Automatic reconnection after cluster 
resource failovers or migrations occurs properly after this one-time reset. 


Some clients might cache the volume IDs. To reset the cached value, the client must be 
rebooted and reconnected to the volume. 


O After the volume is mounted with its new ID, if the backup software is running on a client 
connection, you might need to restart the backup to reconnect to the volume with its new volume 
ID. Automatic reconnection after cluster resource failovers or migrations occurs properly after 
this one-time reset. 


Expanding the Size of a Clustered Pool 


NSS pools are made up of segments of space from one or more devices up to a maximum total size 
of 8 TB (terabytes). Each device can be up to 2 TB in size if a DOS partitioning scheme is used, or up 
to 8 TB in size if a GPT partitioning scheme is used. You can expand a pool by adding more space 
from the same device or from a different shared device. If you extend the size of a LUN device that is 
currently being used by the pool, you must make the extended size visible to all nodes in the cluster 
before you add the newly available space to the clustered pool. If you add a new shared LUN device, 
you must make the device visible to all nodes in the cluster before you add space from the device to 
the clustered pool. 


¢ Section 12.18.1, “Planning to Expand a Clustered Pool,” on page 305 


¢ Section 12.18.2, “Increasing the Size of a Clustered Pool by Extending the Size of Its LUN,” on 
page 306 
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¢ Section 12.18.3, “Increasing the Size of a Clustered Pool by Adding Space from a Different 
Shared LUN,” on page 311 


¢ Section 12.18.4, “Verifying the Expanded Pool Cluster Resource on All Nodes,” on page 315 


Planning to Expand a Clustered Pool 


Consider the guidelines in this section when you plan to expand the size of a clustered NSS pool. 


+ “Free Space on a Shared Device” on page 305 

+ “Extending a LUN Might Require a Service Outage” on page 305 
+ “Adding a LUN Might Require a Service Outage” on page 305 

+ “Multipath I/O Devices” on page 306 


Free Space on a Shared Device 


To expand the size of a pool, you need free unpartitioned space on the same shared device or on 
other shared devices that can be failed over to the same node in a cluster. To extend the size of an 
existing LUN, the free unpartitioned space must immediately follow the LUN on the same shared 
device. 


Extending a LUN Might Require a Service Outage 


Novell Cluster Services and NSS allow you to perform an online extension of a LUN that is used by a 
clustered pool without taking the resource offline or stopping Cluster Services. However, not all SAN 
storage arrays and vendor-specific storage drivers fully support transparent online extension of 
LUNs. Refer to the third-party vendor documentation for information about how to extend a LUN. We 
recommend that you test the specific hardware environment and hardware configuration to confirm 
that it behaves correctly before you perform an online LUN extension. 


IMPORTANT: To prevent any chance of data loss or corruption, we recommend that you back up the 
volumes before you expand a LUN. 


After you extend the LUN size on the SAN storage array, you must scan for devices on each node to 
update the node’s storage map with its new size information before you expand the pool size on the 
active node, or allow the pool cluster resource to fail over to other nodes. If the device has multiple 1/ 
O paths, you must also update each node’s multipath map. Depending on your SAN storage array, 
device driver, and server hardware, a server restart might be required to force the node to recognize 
the extended LUN size. 


Adding a LUN Might Require a Service Outage 


Novell Cluster Services and NSS allow you to add a LUN to a clustered pool without taking the 
resource offline or stopping Cluster Services. The LUN must be able to be failed over to the same 
node in a cluster as the pool cluster resource. Refer to the third-party vendor documentation for 
information about how to add a LUN. 


After you create a new LUN on the SAN storage array and assign it to all nodes, you must scan for 
devices on each node to update the node’s storage map with the new device before you expand the 
pool size on the active node, or allow the pool cluster resource to fail over to other nodes. If the 
device has multiple I/O paths, you must also update each node’s multipath map. Depending on your 
SAN storage array, device driver, and server hardware, a server restart might be required to force the 
node to recognize the new LUN. 
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Multipath I/O Devices 


Consider the following requirements and guidelines as you work with devices that have multiple I/O 
paths: 


+ The procedures in this section assume that you use the Linux Device Mapper - Multipath I/O 
(DM-MPIO) software to manage the multiple I/O paths for devices. You must modify the 
instructions accordingly if you are using a third-party multipath solution. 


¢ Before you expand the pool size on the active node or allow the pool cluster resource to fail over 
to other nodes, you must update the multipath map on each node in the cluster so that DM-MPIO 
recognizes the LUN changes: 
+ Extend the LUN size: On each node, you can restart the mult ipathd daemon, or you can 
use the multipathd command to resize the multipath map for the LUN. 


+ New LUN: On each node, use the multipath -v2 command to rebuild the node’s 
multipath map. 
¢ Fora device with multiple I/O paths, use the device’s multipath device name (Such as mpathb) or 
device ID. 


Steps in this section that pertain only to multipath I/O devices are preceded by the keyword 
“MPIO”. 


+ 


Increasing the Size of a Clustered Pool by Extending the 
Size of Its LUN 


One way to increase the size of a clustered pool is to add space to its LUN device on the SAN storage 
array, and then increase the size of the pool to use the newly available space. Before you extend the 
size of a LUN, ensure that you understand the cautions in “Extending a LUN Might Require a Service 
Outage” on page 305. 

¢ “Extending the Size of a LUN” on page 306 

¢ “Increasing the Pool Size by Using Free Space on the Same LUN” on page 309 


Extending the Size of a LUN 


You can extend the size of the LUN if there is free unpartitioned space on the device that immediately 
follows the LUN. If the LUN has multiple I/O paths, special handling is required to update the device 
size reported in the multipath map on each node. These steps are marked with the keyword “MPIO”. 
1 Identify the device that is used by the pool cluster resource: 
1a In iManager, go to Storage > Pools, then select the Cluster object of the cluster. 


1b In the Pools list, select the pool, then view the device name of the LUN under the pool 
Details area. 


For example, a device with a single path has a device node name such as sdb. A device 
with multiple I/O paths has a multipath device name such as mpathb. 


2 (Offline LUN extension only) If the SAN storage array or vendor-specific storage driver does not 
support online LUN extension, take the pool cluster resource offline. Open a terminal as the root 
user, then at the command prompt, enter: 


cluster offline <resource_name> 


3 On the SAN storage array, use the third-party vendor tools to extend the size of the existing LUN. 
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Devices can be up to 2 TB in size with the DOS partitioning scheme. Devices can be up to 8 TB 
in size with the GPT partitioning scheme. 


For example, increase the size of the existing LUN from 100 GB to 150 GB. 


4 Beginning with the active node, perform the following steps on each node in turn in order to 
update the node’s storage map with the new LUN size: 


4a Log in to the node as the root user, then open a terminal console. 


4b Scan for devices to recognize the new size for the LUN. At the command prompt, enter: 


4c 


4d 


/bin/rescan-scsi-bus.sh -forcerescan [--luns=XxX] 


WARNING: In EMC PowerPath environments, do not use the rescan-scsi-bus.sh utility 
provided with the operating system or the HBA vendor scripts for scanning the SCSI buses. 
To avoid potential file system corruption, EMC requires that you follow the procedure 
provided in the vendor documentation for EMC PowerPath for Linux. 


Use the --1uns=xx option if you want to scan only for the extended LUN. You can use the 
lsscsi (8) command to locate the LUN number for the device. Information for each device 
is output on a single line. The first entry is four numbers separated by colons that represent 
the Host : Bus : Target : LUN of the SCSI device. 


For information about other rescan-scsi-bus.sh options, see “Scanning for New Devices 
without Rebooting” (http://www.suse.com/documentation/sles11/stor_admin/data/ 
scandev.html) in the SUSE Linux Enterprise Server 11 Storage Administration Guide (http:// 
www.suse.com/documentation/sles11/stor_admin/data/bookinfo.html). 


Scan for storage objects. At the command prompt, enter: 
nlvm rescan 


(MPIO) If the device has multiple I/O paths, do either of the following to update the multipath 
map with the new size information for the extended LUN: 


+ Resize the multipath map for the LUN: At the command prompt, enter: 
multipathd -k'resize map <mpio_map_ name>' 


There is no space between -k and the r'esize map <mpio_map_name>'option. You 
can use the multipath -11 command to locate the multipath map name for the 
device. 


For example, the following command resizes the map entry for a LUN device with the 
multipath map ID of 36001¢c230ce31da000eb0fa8dlecb0c02: 


multipathd -k'resize map 36001c230ce31da000eb0fa8diccb0c02' 


You can alternatively use the multipathd -k command to enter interactive mode and 
issue the resize map <mpio map name> command. From this mode, the available 
commands can be viewed by entering help. When you are finished entering 
commands, press Ctrl+D to quit. 


+ Restart the multipathd daemon: At the command prompt, enter one of the following 
commands: 


remultipathd restart 


/etc/multipathd restart 
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4e (MPIO) Verify that the new size of the LUN is correctly reported to DM-MPIO. At the 
command prompt, enter: 


multipath -11 


The -11 option shows the current multipath topology from all available information (sysfs, 
the device mapper, path checkers, and so on). 


For example, the mpathb device reports a new size of 150 GB. 


mpathb (36001438005de9b8d0000800007520000) dm-1 HP,HSV450 
[size=150G] [features=1 queue_if_no_path] [hwhandler=0] 
\.. round-robin 0 [prio=100] [active] 


\_ 4:0:1:7 sdae 65:224 [active] [ready] 
\_ 2:0:1:7 sdu 65:64 [active] [ready] 
\_ round-robin 0 [prio=20] [enabled] 

\_ 4:0:0:7 sdv 65:80 [active] [ready] 
\_ 2:0:0:7 sdg 8:96 [active] [ready] 


4f Repeat Step 4a through Step 4e on each node in the cluster. 


Depending on your SAN storage array, device driver, and server hardware, a server restart 
might be required to force a node to recognize the extended LUN size. 


5 In iManager, verify that the new device size is reported correctly to NSS: 
5a In iManager, go to Storage > Devices, then select the Cluster object of the cluster. 


5b Select the device (Such as mpathb), then view the device capacity under the device’s 
Details area. 


For example, the mpathb device’s Capacity field reports a size of 150 GB. 


Server: | serverl.clusters.context a) a 
Devices: Details: 
Initialize Disk | |cciss/cOd0 sine mpathb 
— Multipath... | Major Number: 253 
Set Default Path 
Minor Number: 1 
Reset Registry 
M Shareable for Clustering 
MBR Type: 
© dos @ crt 
Capacity: 15000 GB 
Used Space: 100.00 GB 
Free Space: 50.00 GB 
Pools: POOL! hd BE=| 
Number of Pools: 1 
Partitions: Free - mpathi z E 
Status: 0% Remirrored, Unknown 
OK | Cancel | __ Apply | 


5c If the new LUN size is reported correctly, continue to Step 6. If the size is not reported 
correctly, repeat Step 4, then check again. 


6 (Offline LUN extension only) If you took the pool cluster resource offline in Step 2, you can now 
bring pool cluster resource online. Open a terminal as the root user, then at the command 
prompt, enter: 


cluster online <resource_name> 


7 After the new LUN size has been recognized by all nodes, continue with “Increasing the Pool 
Size by Using Free Space on the Same LUN” on page 309. 
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Increasing the Pool Size by Using Free Space on the Same LUN 


The pool size is not automatically expanded to use the new free space on the LUN. After you have 


expanded the size of the existing LUN and the new size is recognized by all nodes in the cluster, you 


can increase the size of the pool by allocating space from the newly available free space. 


1 In iManager, go to Storage > Pools, then select the Cluster object of the cluster. 
2 On the Pool page, select the pool, then view the pool’s current size in the Pool Details area. 


The Total Space for the pool reports only the amount of space that has been allocated to the 
pool. The pool size is not automatically expanded to use the new free space on the LUN. 


Pools: 


New... POOH 


Activate 


Deactivate 
Increase size... 
Snapshot... 


Properties... 
_Updatee eDirectory | 


Deleted Volumes 


Offtine 


3 Increase the size of the pool by adding space from the same LUN: 
3a On the Pool page, select the pool, then click Increase Size. 
The Expand a Pool wizard opens and presents all devices with available free space. 


3b In the list of devices, select the check box for the newly expanded LUN, such as mpathb, 


Details: 


Name: POOL1 

Mount Point: fopt/novell/nss/mnt/.pools/POOL1 

Partitions: mpathb1.1 >| E 

Number of Partitions; 1 

State: Active 

LSS Type: ZLss 

Share State: Sharable for Clustering 

Volumes: volt nd BE 

Number of Volumes: 1 

Devices: [mpathb z] fst 

Number of Devices: 1 

Free Space: 160.00 KB 

Used Space: 100.00 GB 
Purgeable Space: 0.00 GB 
Other in-use space: 100.00 GB 

Block Size: 4.00 KB 

Creation Date: Sep 16, 2010 2:58:27 pm 

Last Update: Sep 16, 2010 2:58:27 pm 


then specify the amount of space to add in MB. 


Typically, this is the reported amount of free space available. For example: 


Used Size (MB) 


i 


kaj 
nH 
i 


4 


ii 


Pool Size: 153599 


Device Name Free Size (MB) 


mpatha 
mpathb 
mpathe 
mpathd 
mpathe 
mpathf 
mpathg 


mpathh 


3c Click Finish to save and apply the change. 
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1015 


51201 


102399 


20479 


20479 


20479 


20479 


20479 


309 


310 


4 On the Pool page, select the pool, then verify that the Total Space field reports the new size. 


For example, the new size of PooL1 is 150 GB. 


Pools: 
New, 
Delete 
Rename. 
Activate 


Deactivate 


Increase size... 


Deleted Volumes.. 


Offline 


Details: 
Name: POOL1 
Mount Point: /opt/novell/nss/mnt/.pools/PO0L1 


Partitions: mpathb1.1 z] Est 


Number of Partitions: 2 


State: Active 

LSS Type: ZLSS 

Share State: Sharable for Clustering 

Volumes: volt x] A 

Number of Volumes: 1 

Devices: mpathb z] E 

Number of Devices: 1 

Free Space; 49.85 GB 

Used Space: 100.15 GB 
Purgeable Space: 0.00 GB 
Other in-use space: 100.15 GB 

Block Size: 4.00 KB 

Creation Date: Sep 16, 2010 2:58:27 pm 

Last Update: Sep 16, 2010 2:58:27 pm 


5 Go to Storage > Partitions, then verify that a new partition exists for the LUN and is assigned to 


the pool. 


For example, the partitions mpathb1.1 and mpathb1.2 are allocated to Poot. 


Server: [serverl.clusters.context AH 

New | Edit | Delete | Details 

I Name + Type v Status ~ Device Name ~ RAID Name ~ Pool Name + Size 
I cciss/c0d0_freespace! Free Space Available cciss/c0d0 27.07 MB 
I eciss/c0d0p1 Linux In Use eciss/c0d0 509.84 MB 
I cciss/c0d0p2 Linux Swap In Use eciss/c0d0 15.99 GB 
I cciss/c0d0p3 Linux In Use eciss/cOd0 256.88 GB 
I clustert.sbd Clustering InUse — mpatha 7.98 MB 
I mpatha1.nwfreespace1 Free Space Available mpatha 7.66 MB 
I mpatha_freespace1 Free Space Available mpatha 1008.31 MB 
I mpathb1.1 NSS In Use mpathb POOLI 100.00 GB 
I mpathb1.2 NSS In Use mpathb POOL1 50.00 GB 
I mpathb_freespace1 Free Space Available mpathb 2.34 MB 


6 For each volume on the pool, if the volume quota is set to No Quota, the volume can grow to the 
size of the pool. Go to Storage > Volumes, select the volume, then verify that its Available Space 
field has increased by the amount of space that was added to the pool. 


OES 11 SP3: Novell Cluster Services for Linux Administration Guide 


12.18.3 


For example, by increasing the pool size by 50 GB, the available space for voL1 increased from 
about 82 GB to about 132 GB. 


Volumes 2 
Create and manage NSS volumes, You can also move and split volumes and activate or deactivate volumes. 
Server: | server1.clusters.context a fa 
Volumes: Details: 
E) Name: vou 
— Delete | Host Pool: POOLI 
___Rename... | Owner: [Supervisor] 
Activate Mount Point: émedia/nss/vOL1 
Deactivate State: Active, Mounted 
Mount. Name Space(s): DOS, Mac, Unix, Long 
Dismount Lookup Namespace: Long 
Quota: 0.00 MB 
ti Available Space: 132288.73 MB 
it... 
Used Space: 20851.413MB 
Properties... Purgeable Space: 0.00 MB 
User Quotas... | Number of Objects: 4786 


7 Continue with “Verifying the Expanded Pool Cluster Resource on All Nodes” on page 315. 


Increasing the Size of a Clustered Pool by Adding Space 
from a Different Shared LUN 


You can increase the size of a clustered pool by adding space to the pool from a different shared LUN 
device that can be failed over with the resource. Before you add a LUN, ensure that you understand 
the cautions in “Adding a LUN Might Require a Service Outage” on page 305. 

¢ “Creating and Sharing a New LUN Device” on page 311 

¢ “Increasing the Pool Size by Adding Free Space from a Different LUN” on page 314 


Creating and Sharing a New LUN Device 


If you do not have a shared device that can be failed over with the resource, you can create a new 
LUN and share it with all nodes in the cluster. If the LUN has multiple I/O paths, special handling is 
required to add the device to the multipath map on each node. These steps are marked with the 
keyword “MPIO”. 


1 Use third-party tools for the SAN storage array to create a new shared LUN device, and assign it 
to each cluster node. 


2 Beginning with the active node, perform the following steps on each node in turn in order to 
update the node’s storage map and multipath map with the new device: 


2a Log in to the node as the root user, then open a terminal console. 
2b Scan for devices to help the OS recognize the new LUN. At the command prompt, enter: 


/bin/rescan-scsi-bus.sh -forcerescan 


WARNING: In EMC PowerPath environments, do not use the rescan-scsi-bus.sh utility 
provided with the operating system or the HBA vendor scripts for scanning the SCSI buses. 
To avoid potential file system corruption, EMC requires that you follow the procedure 
provided in the vendor documentation for EMC PowerPath for Linux. 
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For information about other rescan-scsi-bus.sh options, see “Scanning for New Devices 
without Rebooting” (http://www.suse.com/documentation/sles11/stor_admin/data/ 
scandev.html) in the SUSE Linux Enterprise Server 11 Storage Administration Guide (http:// 
www.suse.com/documentation/sles11/stor_admin/data/bookinfo.html). 


2c Use the 1sscsi command to verify that the LUN is seen by the OS. At the command 
prompt, enter: 


lsscsi 


Information for each device is output on a single line. The first entry is four numbers 
separated by colons that represent the Host :Bus: Target : LUN of the SCSI device. In the 
sample output below, the /dev/sdc and /dev/sde devices are two individual paths for LUN 


2. 

# Isscsi 

[4:0:0:0] disk DGC RAID 5 0216 /dev/sdb 
[4:0:0:1] disk DGC RAID 5 0216 /dev/sdf 
[4:0:0:2] disk DGC RAID 5 0216 /dev/sdc 
[4:0:1:0] disk DGC RAID 5 0216 /dev/sdd 
[4:0:1:1] disk DGC RAID 5 0216 /dev/sdg 
[4:0:1:2] disk DGC RAID 5 0216 /dev/sde 


If the LUN is not seen, repeat this step using different 1sscsi command line parameters to 
scan for all devices (Such as -w -c -1). For information about command options, see the 
lsscsi(8) man page. 


If the LUN is still not seen by the OS, a server restart might be required. 
2d Scan for storage objects. At the command prompt, enter: 


nivm rescan 


2e (MPIO) If the device has multiple I/O paths, rebuild the multipath map. At the command 
prompt, enter: 


multipath -v2 


2 


-h 


(MPIO) Verify that the new LUN is reported to DM-MPIO. At the command prompt, enter: 
multipath -11 


The -11 option shows the current multipath topology from all available information (sysfs, 
the device mapper, path checkers, and so on). 


2g Verify that the LUN is now visible to NSS on the node. In NSSMU, go to the Devices page, 
then verify that the new LUN is listed. 


For example, the new device is mpathj on the active node. Remember that a multipath 
device might have a different multipath device name on each node. 


2h Repeat Step 2a through Step 2g on each node in the cluster. 


Depending on your SAN storage array, device driver, and server hardware, a server restart 
might be required to force a node to recognize the new LUN. 
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3 In iManager, initialize the new LUN, then mark it as shareable for clustering: 
3a In iManager, go to Storage > Devices. 
3b On the Devices page, select the Cluster object of the cluster. 
Selecting the Cluster object connects you to the current master node of the cluster. 
3c In the Devices list, select the newly added LUN device. 


WARNING: Ensure that you select the correct device. Initializing a device destroys all data 
on it. 


3d Click Initialize, then click OK to confirm that you want to initialize the device. 


If you are prompted for the partitioning scheme, specify your preferred partitioning scheme 
as DOS (up to 2 TB in size) or GPT (up to 8 TB in size). 


3e In the Devices list, select the new LUN device. 


3f In the Details area, select the Shareable for Clustering check box, then click Apply. 


Server: | server1.clusters.context Q ‘al 


Devices: Details: 


__Initialize Disk | |cciss/cOd0 


Name: mpathj 
mpatha 
Epa |mpathb Major Number: 253 
sepesma] |™Pathe , 
~~ | mpathd Minor Number; 40 
RESER] |rmpathe 
mpathf M Shareable for Clustering 
mpathg MBR Th 
mpathh mm 
FEE 00s © cer 
Capacity: 25.00 GB 
Used Space: 16.00 KB 
Free Space: 25.00 GB 
Pools: a 
Number of Pools: 
Partitions: Free - mpath) >] Eel 
Status: 0% Remirrored, Unknown 
OK | Cancel | Apply | 


4 After the new LUN is recognized by all nodes, and has been initialized and shared, continue with 
“Increasing the Pool Size by Adding Free Space from a Different LUN” on page 314. 
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314 


Increasing the Pool Size by Adding Free Space from a Different LUN 


After you have set up a different shared device that can be failed over with the pool cluster resource, 
you can increase the size of the pool by allocating space from it. 


1 In iManager, go to Storage > Pools, then select the Cluster object of the cluster. 


Selecting the Cluster object automatically connects you to the current master node of a cluster. 


2 Select the pool, then view the pool’s current size. 


The Total Space for the pool reports only the amount of space that has been allocated to the 
pool. For example, Pool? is 20 GB in size. 


Server: | servert.clusters.context CW 
Pools: Details: 
New... POOL Name: POOL7 
Delete POOL2 Mount Point: fopt/novell/nss/mnt/.pools/POOL7 
POOL3 
Rename) | poo, Partitions: mpathht.1 | Fl) 
Activate POOLS Number of Partitions: 1 
POOL6 r 
_ Deactivate | | Frere State: Active 
i ILSS 
Increase size... L55 Type: 
S Share State: Sharable for Clustering 
napshot. .. - 
Volumes: VOL7 hd BE! 
Properties... 
Number of Volumes: 1 
_Update eDirectory | = 
Devices: mpathh >) | 
Deleted Volumes 
ee Number of Devices: 1 
offi 
= Total Space: 20.00 GB 
Free Space: 19.93 GB 
Used Space: 65.89 MB 
Purgeable Space: 20.00 KB 
Other in-use space: 65.87 MB 


3 Increase the size of the pool by adding space from a different LUN: 


3a On the Pool page, select the pool, then click Increase Size. 


The Expand a Pool wizard opens and presents all devices with available free space. 


3b In the list of devices, select the check box for the new LUN, such as mpathj, then specify 
the amount of space to add in MB. 


Typically, this is the reported amount of free space available. For example, mpathj has 
25599 MB available: 


Used Size (MB) 


Device Name 


mpatha 


mpathb 


Free Size (MB) 


1015 


3c 


Pool Size: 46077 


Click Finish to save and apply the change. 
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4 On the Pool page, select the pool, then verify that the Total Space field reports the new size. 
For example, POOL7 has increased in size from 20 GB to about 45 GB. 


Server: | serverl.clusters.context am 


Pools: Details: 


New... POOLI Name: POOL7 
peee) |POOL2 Mount Point: fopt/novell/nss/mnt/.pools/POOL7 
POOL3 
EEEE jroo, Partitions: mpathh1.1 z| E 
Activate POOLS Number of Partitions: 2 
POOL6 g 
Deactivate POOL7 State: Active 
i ZLss 
Increase size... LSS Type: 
m Share State: Sharable for Clustering 
Volumes: VOL7 =) lal 
Properties... 
Number of Volumes: 1 
Update eDi _ 
Devices: mpathh hd al 
Deleted Volumes 
Number of Devices: 2 
Offline 
Total Space: 45.00 GB 
Free Space: 44.86 GB 
Used Space: 138.29 MB 
Purgeable Space: 20.00 KB 


Other in-use space: 138.27 MB 


5 For each volume on the pool, if the volume quota is set to No Quota, the volume can grow to the 
size of the pool. Go to Storage > Volumes, select the volume, then verify that a volume’s 
Available Space field has increased by the amount of space that was added to the pool. 


6 After the pool size is increased, continue with Section 12.18.4, “Verifying the Expanded Pool 
Cluster Resource on All Nodes,” on page 315. 


12.18.4 Verifying the Expanded Pool Cluster Resource on All Nodes 


Verify that the expanded pool size is reported correctly on each node in the cluster. 


1 Log in to a node as the root user, then open a terminal console. 


2 Cluster migrate the pool cluster resource to each node in turn, and use NSSMU to verify that the 
devices, partitions, pool, and volumes show the correct information on that server: 


2a Cluster migrate the pool cluster resource. 
cluster migrate resource_name node_name 
2b Launch NSSMU by entering 
nssmu 


2c On the Devices page, select the device and verify that the new size is reported. 


2d On the Partitions page, select each partition for the device, then verify that the partitions are 
shown for the expanded pool. 


2e On the Pools page, select the pool, then verify the total space available. 


2f On the Volumes page, select each volume that has no quota set, then verify that the 
available space has increased by the amount of space added to its pool. 


2g Ifthe information is incorrect, wait a few minutes to allow time for the system to recognize 
the new partitions, then try again. 


3 Repeat the previous validation for each node in the cluster. 
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12.19 Deleting NSS Pool Cluster Resources 


Ensure that you offline the cluster resource before attempting to delete either the cluster resource or 
the clustered pool. For example, if you want to unshare a pool, offline the cluster resource for the pool 
before you mark the pool or the device as Not Shareable for Clustering, then you can delete the 
eDirectory object for the cluster resource. 


WARNING: If you attempt to delete a cluster resource without first offlining it, deletion errors occur, 
and the data associated with the clustered pool is not recoverable. 


All resource configuration must happen from the master node. On the Cluster Options page for 
iManager, you are automatically connected to the Cluster object, which is associated with the master 
node. On the Storage > Pools page for iManager, connect to the Cluster object, not to the individual 
servers. Run NSSMU only on the master node. 


See Section 10.16, “Deleting Cluster Resources, or Disabling Clustering for a Pool, LVM Volume 
Group, or Service,” on page 228. 


12.20 Disabling Clustering for a Pool 


You can disable clustering for a pool by deleting the resource-related objects, and then re-creating 
the Pool and Volume objects on a desired node and unsharing the device. We strongly recommend 
that you delete the resource for a pool from the master node in the cluster. 


The Cluster Options page of the Clusters plug-in for iManager provides a Delete option that 
automatically deletes the resource-related objects in eDirectory and updates the cluster information: 
¢ Cluster-named Pool object 
¢ Cluster-named Volume object for each of the pool’s volumes 
¢ Cluster Resource object for the pool 
¢ Virtual server for the cluster resource (NCS:NCP Server object) 
Ensure that you offline the cluster resource before attempting to delete either the cluster resource or 
the clustered pool. For example, if you want to unshare a pool, you must offline the cluster resource 


for the pool before you mark the device as Not Shareable for Clustering. Then you can delete the 
eDirectory object for the cluster resource. 


WARNING: If you attempt to delete a cluster resource without first offlining it, deletion errors occur, 
and the data associated with the clustered pool is not recoverable. 


All resource configuration must happen from the master node. On the Cluster Options page for 
iManager, you are automatically connected to the Cluster object, which is associated with the master 
node. On the Storage > Pools page for iManager, connect to the Cluster object, not to the individual 
servers. Run NSSMU only on the master node. 


This deletes the resource-related objects, but not the storage area they represent. 
Use the following procedure to disable clustering for a pool: 


1 If the resource is on a non-master node in the cluster, migrate it to the master node. 


As the root user, open a terminal console, then enter 


cluster migrate <resource_ name> <master_node_name> 
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The master node must be in the resource’s preferred nodes list. To view or modify the list, see 
Section 10.10, “Configuring Preferred Nodes and Node Failover Order for a Resource,” on 
page 216. 


2 Use the cluster status command to check the resource status. If the resource is online or 
comatose, take it offline by using one of the following methods: 


+ 


Enter the following at the command prompt as the root user: 
cluster offline <resource_name> 


Use the cluster status command to verify that the resource has a status of Offline before 
you continue. 


In iManager, go to Clusters > My Clusters, then select the cluster. On the Cluster Manager 
page, select the check box next to the cluster resource, then click Offline. 


Refresh the Cluster Manager page to verify that the resource has a status of Offline before 
you continue. 


3 In iManager, use the Clusters plug-in to delete the cluster resource. 


3a 
3b 
3c 
3d 


3e 


Select Clusters > My Clusters, then select the cluster. 
Select the Cluster Options tab. 
Select the check box next to the resource, then click Delete. 


When you are prompted to confirm the deletion, click OK to continue, or click Cancel to 
abort the deletion. 


In the Tree View in iManager, browse to verify that the Cluster Resource object and related 
objects were removed from eDirectory. 


If necessary, you can manually delete the objects. In iManager, go to Directory 
Administration > Delete Objects, select the objects, then click OK. 


4 Use the Update eDirectory function to re-create Storage objects for the pool and its volumes. 


4a 


4b 
4c 


4d 
4e 
4f 


4g 
4h 


In iManager, select Storage > Pools, then select the node where you want the pool to reside 
as a locally available pool. 


Select the pool, then click Activate. 
Select the pool, then click Update eDirectory. 


This creates a Pool object in eDirectory with a name format of 
<server name> <pool name> POOL. 


Select Storage > Volumes. The server should still be selected. 
Select the volume, then click Mount. 
Select the volume, then click Update eDirectory. 


This creates a Volume object in eDirectory with a name format of 
<server_ name>_<volume_name>. 


Repeat Step 4e through Step 4f for each volume in the pool. 


In the Tree View in iManager, browse to verify that the server-named Pool object and 
Volume object were created. 
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For example, the following Tree View shows the Pool object avalon_POOLD POOL and the 
Volume object avalon_VOLD were created for server avalon. 


Tree \ Browse \ Search \ 


Context: | novell } 


Name: |' | 


Type: | All Available Types D 


Load Apply Save 


Objects: Multiple Select 
£| avalon VOLD | “| 


avalon 


avalon-PS 


LDAP Server- avalon 


LDAP Group - avalon 


Http Server - avalon 
SAS Serice - avalon 


DNS 


SSL CertificateDNS - avalon 
SSL CertificatelP - avalon 
SNMP Group - avalon 

UNIX Workstation - avalon 


UNIX Config 


SAE e i A A U a AAA 


avalon POOLD POOL L 


<< Previous | Next | {100 | 


5 Unshare the devices that contribute space to the pool, then use a third-party SAN management 
tool to assign the devices to only the desired server. 


5a In iManager, go to Storage > Devices, then select the desired server (the one you specified 
in Step 4). 


5b Select the device. 
5c Deselect the Shareable for Clustering check box, then click Apply. 


Unsharing a device fails if the device contains a cluster-enabled pool or split-brain detector 
(SBD) partition. This is unlikely to be an issue if you used a dedicated device (or devices) for 
the pool where you have disabled clustering. 


5d Repeat these steps for each device that contributes space to the pool. 
5e Use a third-party SAN management tool to assign the devices to only the desired server. 


6 Provide the node’s IP address to users who access volumes on the non-clustered pool. 


12.21 Deleting and Re-Creating a Pool Cluster Resource 
(Disabling and Re-Enabling Clustering for a Pool) 
You can re-create the resource objects for a pool by deleting the resource-related objects, creating 
new Pool and Volume objects, and then cluster-enabling the existing pool. This is the same as 


disabling and re-enabling clustering for a pool. We strongly recommend that you delete the resource 
for a pool from the master node in the cluster. 


The Cluster Options page of the Clusters plug-in for iManager provides a Delete option that 
automatically deletes the resource-related objects in eDirectory and updates the cluster information: 


+ Cluster-named Pool object 


¢ Cluster-named Volume object for each of the pool’s volumes 
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¢ Cluster Resource object for the pool 
¢ Virtual server for the cluster resource (NCS:NCP Server object) 


This deletes the resource-related objects, but not the storage area they represent. To delete a 
resource and create a new one with the same name, you must wait to create the new one until 
eDirectory synchronizes all of the objects in the tree related to the deleted resource. 


Ensure that you offline the cluster resource before attempting to delete either the cluster resource or 
the clustered pool. For example, if you want to unshare a pool, offline the cluster resource for the pool 
before you mark the device as Not Shareable for Clustering. Then you can delete the eDirectory 
object for the cluster resource. 


WARNING: If you attempt to delete a cluster resource without first offlining it, deletion errors occur, 
and the data associated with the clustered pool is not recoverable. 


All resource configuration must happen from the master node. On the Cluster Options page for 
iManager, you are automatically connected to the Cluster object, which is associated with the master 
node. On the Storage > Pools page for iManager, connect to the Cluster object, not to the individual 
servers. Run NSSMU only on the master node. 


Use the following procedure to delete and re-create a cluster resource for a pool: 


1 If the resource is on a non-master node in the cluster, migrate it to the master node. 
As the root user, open a terminal console, then enter 


cluster migrate <resource_ name> <master_node_name> 


The master node must be in the resource’s preferred nodes list. To view or modify the list, see 
Section 10.10, “Configuring Preferred Nodes and Node Failover Order for a Resource,” on 
page 216. 


2 Use the cluster status command to check the resource status. If the resource is online or 
comatose, take it offline by using one of the following methods: 


+ Enter the following at the command prompt as the root user: 
cluster offline <resource_name> 
Use the cluster status command to verify that the resource has a status of Offline before 
you continue. 


+ In iManager, go to Clusters > My Clusters, then select the cluster. On the Cluster Manager 
page, select the check box next to the cluster resource, then click Offline. 


Refresh the Cluster Manager page to verify that the resource has a status of Offline before 
you continue. 


3 In iManager, use the Clusters plug-in to delete the cluster resource. 
3a Select Clusters > My Clusters, then select the cluster. 
3b Select the Cluster Options tab. 
3c Select the check box next to the resource, then click Delete. 


3d When you are prompted to confirm the deletion, click OK to continue, or click Cancel to 
abort the deletion. 


3e Inthe Tree View in iManager, browse to verify that the Cluster Resource objects and related 
objects were removed from eDirectory. 


If necessary, you can manually delete the objects. In iManager, go to Directory 
Administration > Delete Objects, select the objects, then click OK. 
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4 Use the Update eDirectory function to re-create Storage objects for the pool and its volumes. 


These objects are needed by Novell Cluster Services when you re-create the resource. 


4a In iManager, select Storage > Pools, then select the master node if you plan to re-create the 


4b 
4c 


4d 
4e 
4f 


4g 
4h 


storage object, or select the node where you want the pool to reside as a locally available 
pool. 


Select the pool, then click Activate. 
Select the pool, then click Update eDirectory. 


This creates a Pool object in eDirectory with a name format of 
<server name> <pool name> POOL. 


Select Storage > Volumes. The server should still be selected. 
Select the volume, then click Mount. 

Select the volume, then click Update eDirectory. 

This creates a Volume object in eDirectory with a name format of 


<server name>_<volume_name>. 


Repeat Step 4e through Step 4f for each volume in the pool. 


In the Tree View in iManager, browse to verify that the Pool object and Volume object were 
created. 


For example, the following Tree View shows the Pool object avalon_POOLD POOL and the 
Volume object avalon_VOLD were created for server avalon. 


Tree \ Browse \ Search \ 


Context: | novell 


Name: |' | 


Type: | All Available Types | 


Load Apply Save 


Objects: Multiple Select 


A 


avalon VOLD 


avalon 

avalon-PS 

LDAP Serer- avalon 
LDAP Group - avalon 
Http Server- avalon 


SAS Service - avalon 


DNS AG avalon. mtn\example\.com - avalon 


IP AG 10\.10\.10\,37 - avalon 
SSL CertificateDNS - avalon 


SSL CertificatelP - avalon 


hall 
BUGUUESRASOw 


SNMP Group - avalon 
Eg UNIX Workstation - avalon 


UNIX Config 


© avalon POOLD POOL 


<< Previous | NEXESS| (100 ) 


5 Use the Clusters plug-in to cluster-enable the pool: 


For detailed instructions, see Step 5 thru Step 18 in Section 12.5, “Cluster-Enabling an Existing 
NSS Pool and Its Volumes,” on page 253. 


To re-create the cluster resource with the same name, you must wait to create the new one until 
eDirectory synchronizes all of the objects in the tree related to the deleted resource. 


5a 
5b 


In Roles and Tasks, select Clusters > My Clusters, select the cluster. 
Select the Cluster Options tab. 
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5c On the Cluster Options page, click the New link in the Cluster Objects toolbar. 


5d On the Resource Type page, select the Pool radio button, then click Next. 


5e On the Cluster Pool Information page, specify the following information, then click Next: 


5f 


5g 


The Cluster Pool Information page opens. 


My Clusters > clus1.ncs.novell > New Resource 
New Resource [2] 


Cluster Pool Information Cluster-enable a pool 


Pool Name: || EC 


Virtual Server Name: | J 
CIFS Server Name: 


IP Address { ] 
Advertising Protocols: 

O are 

O ars 

“NCP 


C] online Resource after Creation 
Only select this option if you have verified that the pool is in an de-active state, otherwise the resource will go comatose during creation. 


M1 Define Additional Properties 


<<Back | Next>> | Cancel | 


+ Pool name 

¢ Virtual server name 

+ IP address 

+ Advertising protocols (NCP, AFP, CIFS) 

¢ If you enable CIFS, specify the CIFS Server name. 

¢ Deselect the Online Resource after Creation check box. 
¢ Select the Define Additional Properties check box. 


My Clusters > clus1.ncs.novell > New Resource 


New Resource 
E] Cluster Pool Information Cluster-enable a pool. 


Pool Name: | avalon_POOLC1_POOL.novell | @ 


Virtual Server Name: |CLUS1-POOLC1-SERVER | 


CIFS Server Name: | CLUS1-POOLC1-W 
IP Address {10.10.1043 | 
Advertising Protocols: 

O arp 

O ars 

Vi Ncp 


C] online Resource after Creation 
Only select this option if you have verified that the pool is in an de-active state, otherwise the resource will go comatose during creation. 


M Detine Additional Properties 


<<Back | Next>> | Cancel | 


On the Resource Policies page, configure the resource policies for the start, failover, and 


failback modes, then click Next. 


See “Configuring the Start, Failover, and Failback Modes for Cluster Resources” on 


page 214. 


On the Resource Preferred Nodes page, assign the preferred nodes to use for the resource, 


then click Finish. 


See “Configuring Preferred Nodes and Node Failover Order for a Resource” on page 216. 
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12.22 


12.22.1 


The pool cluster resource appears in the Cluster Objects list on the Cluster Options page, 
such aS POOL1_ SERVER. 


5h (Optional) View the resource properties, and enable monitoring and configure the 
monitoring script. 


5i Bring the resource online. Select the Cluster Manager tab, select the check box next to the 
resource, then click Online. 


The pool is activated and its volumes are mounted on the primary preferred node that is 
configured for the pool cluster resource. 


If the pool goes comatose, take it offline, check that the pool is deactivated on the local 
server, then try again. 


Deleting a Clustered Pool 


We strongly recommend that you delete a cluster-enabled pool only from the master node in the 
cluster. This allows the cluster information to be automatically updated. 


WARNING: Deleting a pool destroys all data on it. 


NSS management tools delete the cluster-enabled pool and its related objects in eDirectory: 


+ 


+ 


+ 


+ 


+ 


Pool and its volumes from the file system and from NCP 
Cluster-named Pool object 

Cluster-named Volume object for each of the pool’s volumes 
Cluster Resource object for the pool 

Virtual server for the cluster resource (NCS:NCP Server object) 


When the pool resides on the master node, the cluster information is automatically updated. 


When the pool resides on a non-master node, additional steps are required to update the cluster 
information. A cluster restart might be needed to force the information to be updated. 


Use the following procedures to delete a cluster-enabled pool: 


+ 


+ 


Section 12.22.1, “Deleting a Clustered Pool on the Master Node,” on page 322 
Section 12.22.2, “Deleting a Clustered Pool on a Non-Master Node,” on page 323 


Deleting a Clustered Pool on the Master Node 


1 If the pool cluster resource is on a non-master node in the cluster, migrate it to the master node. 


As the root user, open a terminal console, then enter 
cluster migrate <resource_name> <master_node_name> 


To migrate the resource, the master node must be in the resource’s preferred nodes list. To view 
or modify the list, see Section 10.10, “Configuring Preferred Nodes and Node Failover Order for 
a Resource,” on page 216. 


Use the cluster status command to check the resource status. If the resource is online or 
comatose, take it offline by using one of the following methods: 


+ As the root user, enter 


cluster offline <resource_name> 
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Use the cluster status command to verify that the resource has a status of Offline before 
you continue. 


+ In iManager, go to Clusters > My Clusters, then select the cluster. On the Cluster Manager 
page, select the check box next to the cluster resource, then click Offline. 


Refresh the Cluster Manager page to verify that the resource has a status of Offline before 
you continue. 


3 Delete the pool on the master node by using NSSMU. 


You can alternatively use the Storage plug-in in iManager or the nlvm delete pool 
<pool_name> command. 


3a In NSSMU, select Pools, then press Enter. 
3b Select the deactive pool, then press Delete. 
3c Select OK to confirm, then press Enter. 
4 Inthe Tree View in iManager, browse the objects to verify that the following objects were deleted: 
+ Pool object 


+ Volume object (for each volume in the pool) 


+ 


Pool cluster resource object (from the Cluster container) 


+ 


Virtual server for the resource (NCS:NCP Server object) 
5 (Optional) Unshare the device: 


5a In iManager, go to Storage > Devices, then select the node where you want the unshared 
device to reside. 


5b Select the device. 
5c Deselect the Shareable for Clustering check box, then click Apply. 


Unsharing a device fails if the device contains a cluster-enabled pool or split-brain detector 
(SBD) partition. This is unlikely to be an issue if you used a dedicated device (or devices) for 
the cluster-enabled pool you deleted. 


5d Repeat Step 5b to Step 5c for each device that contributes space to the pool. 


5e Use a third-party SAN management tool to assign the devices to only the desired server. 


12.22.2 Deleting a Clustered Pool on a Non-Master Node 


1 Log in as the root user to the non-master node where the cluster resource currently resides, 
then open a terminal console. 


2 Use the cluster status command to check the resource status. If the resource is online or 
comatose, take it offline by using one of the following methods: 


cluster offline <resource_name> 


Use the cluster status command to verify that the resource has a status of Offline before you 
continue. 


3 At the command prompt on the non-master node, enter 
/opt/novell/ncs/bin/nes-configd.py -init 


4 Look at the file /var/opt/novell/ncs/resource-priority.conf to verify that it has the same 
information (REVISION and NUMRESOURCES) as the file on the master node. 


5 Delete the pool on the non-master node by using NSSMU. 
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You can alternatively use the Storage plug-in in iManager or the nlvm delete pool 
<pool_name> command. 


5a In NSSMU, select Pools, then press Enter. 
5b Select the pool, then press Delete. 
5c Select OK to confirm, then press Enter. 
6 Inthe Tree View in iManager, browse the objects to verify that the following objects were deleted: 


+ 


Pool object 


+ 


Volume object (for each volume in the pool) 


+ 


Pool cluster resource object (from the Cluster container) 


+ 


Virtual server for the resource (NCS:NCP Server object) 


7 On the master node, log in as the root user, open a terminal console, then enter 
/opt/novell/ncs/bin/ncs-configd.py -init 


8 Look atthe file /var/opt /novell/ncs/resource-priority.conf to verify that it has the same 
information (REVISION and NUMRESOURCES) as that of the non-master node where you 
deleted the cluster resource. 


9 In iManager, select Clusters > My Clusters, select the cluster, then select the Cluster Options 
tab. 


10 Click Properties, select the Priorities tab, then click Apply on the Priorities page. 


11 Ata command prompt, enter 
cluster view 


The cluster view should be consistent. 


12 Look at the file /var/opt /novell/ncs/resource-priority.conf on the master node to verify 
that the revision number increased. 


If the revision number increased, skip Step 13 and continue with Step 14. 


If the deleted resource is the only one in the cluster, the priority won't force the update. A 
phantom resource might appear in the interface. You need to restart Cluster Services to force the 
update, which also removes the phantom resource. 


13 If the revision number did not automatically update in the previous steps, restart Novell Cluster 
Services by entering the following on one node in the cluster: 


cluster restart [seconds] 


For seconds, specify a value of 60 seconds or more. 


For example: 
cluster restart 120 


14 (Optional) Unshare the device: 


14a In iManager, go to Storage > Devices, then select the node where you want the unshared 
device to reside. 


14b Select the device. 
14c Deselect the Shareable for Clustering check box, then click Apply. 


Unsharing a device fails if the device contains a cluster-enabled pool or split-brain detector 
(SBD) partition. This is unlikely to be an issue if you used a dedicated device (or devices) for 
the cluster-enabled pool you deleted. 


324 OES 11 SP3: Novell Cluster Services for Linux Administration Guide 


14d Repeat Step 14b to Step 14c for each device that contributes space to the pool. 
14e Use a third-party SAN management tool to assign the devices to only the desired server. 
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Configuring and Managing Cluster 
Resources for Shared LVM Volume 
Groups 


After you have installed and configured Novell Cluster Services, you can create shared cluster 
resources for Linux Logical Volume Manager (LVM) volume groups. You create an LVM logical 
volume on the volume group, and add a Linux POSIX file system such as Btrfs, Ext2, Ext3, ReiserFS, 
and XFS. This section describes how to configure and manage an LVM volume group cluster 
resource. 

¢ Section 13.1, “Requirements for Creating LVM Cluster Resources,” on page 327 

¢ Section 13.2, “Initializing a SAN Device,” on page 330 


¢ Section 13.3, “Configuring an LVM Volume Group Cluster Resource with NSS Management 
Tools,” on page 334 


¢ Section 13.4, “Configuring an LVM Cluster Resource with LYM Commands and the Generic File 
System Template,” on page 353 


¢ Section 13.5, “Creating a Virtual Server Object for an LVM Volume Group Cluster Resource,” on 
page 367 


¢ Section 13.6, “Enabling NCP File Access for a Clustered LVM Volume,” on page 373 

¢ Section 13.7, “Modifying the LVM Resource Scripts for Other Services,” on page 380 

¢ Section 13.8, “Renaming the Mount Point Path for a Clustered LVM Volume,” on page 381 
¢ Section 13.9, “Renaming a Clustered LVM Logical Volume,” on page 382 


¢ Section 13.10, “Disabling Clustering for an LVM Volume Group and Logical Volume,” on 
page 384 


¢ Section 13.11, “Deleting a Clustered LVM Volume Group and Logical Volume,” on page 390 
¢ Section 13.12, “Deleting a Clustered LVM Volume (Created in NSSMU or NLVM),” on page 393 
¢ Section 13.13, “Linux LVM Management Tools,” on page 396 


13.1 Requirements for Creating LVM Cluster Resources 


Your system must meet the requirements in this section in addition to the cluster requirements 
described in Chapter 4, “Planning for Novell Cluster Services,” on page 47. 

¢ Section 13.1.1, “Novell Cluster Services,” on page 328 

¢ Section 13.1.2, “Linux Logical Volume Manager 2 (LVM2),” on page 328 

¢ Section 13.1.3, “Clustered Logical Volume Manager Daemon (CLVMD),” on page 328 

¢ Section 13.1.4, “Resource IP Address,” on page 328 

¢ Section 13.1.5, “Shared Storage Devices,” on page 328 

¢ Section 13.1.6, “All Nodes Must Be Present,” on page 328 

¢ Section 13.1.7, “Working in Mixed Node OES Clusters,” on page 329 

¢ Section 13.1.8, “NCP File Access with Novell NCP Server,” on page 329 
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13.1.1 


13.1.2 


13.1.3 


13.1.4 


13.1.5 


13.1.6 


¢ Section 13.1.9, “SMB/CIFS File Access with Novell Samba,” on page 330 
¢ Section 13.1.10, “Linux File Access Protocols,” on page 330 


Novell Cluster Services 


Novell Cluster Services must be installed, configured, and running when you create and manage the 
shared LVM volume group and logical volume. The cluster must be active. 


Linux Logical Volume Manager 2 (LVM2) 


The Linux Logical Volume Manager (LVM) 2 software supports LVM volume groups and logical 
volumes. LVM2 must be installed and running on each node in the cluster. LVM2 runs automatically 
on OES 11 and later servers; no separate installation or setup is required. 


Clustered Logical Volume Manager Daemon (CLVMD) 


The Linux Clustered Volume Manager Daemon (CLVMD, clvmd) software allows you to exclusively 
mount a shared volume group on one node at a time in a cluster. It distributes the LVM metadata 
updates around a cluster. CLVM must be installed and running on each node in the cluster. CLVMD 
runs automatically on OES 11 and later servers; no separate installation or setup is required. 


IMPORTANT: Ensure that you have installed the latest patches for SUSE Linux Enterprise Server 11 
SP1 and later. Clustered LVM volume groups require Linux kernel version 2.6.32.45-0.3 or later. 


Resource IP Address 


Each cluster resource requires a unique static IP address that is in the same subnet as the IP 
addresses that are used for the cluster and cluster nodes. The IP address is used to provide access 
and failover capability for the cluster-enabled volume. 


Shared Storage Devices 


The shared SAN storage device that you use for an LVM volume group cluster resource must be 
initialized and have no partitions on it. When the device is used in a cluster resource, LVM uses the 
entire device for the volume group. Ensure that you size your LUNs accordingly. Use the SAN 
management tools to assign the LUN to all nodes in the cluster. 


IMPORTANT: If you use NSS management tools to manage devices, do not enable the Shareable for 
Clustering option. Doing so adds a 4 KB partition to the device, which makes it unavailable to LVM. 


All Nodes Must Be Present 


LVM requires the presence of all the nodes in the cluster to modify the metadata on shared storage. 
This allows LVM to get the exclusive locks it needs to perform actions on shared storage. 


Before you attempt to create or modify LVM volume group cluster resources: 


¢ All of the nodes must be joined in the cluster and running properly. 


+ The clvmd daemon must be running on all nodes. 
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13.1.7 


13.1.8 


Working in Mixed Node OES Clusters 


LVM volume group cluster resources are not supported in mixed-node OES clusters when you 
upgrade from OES 2 SP3 to OES 11 (or later). Complete the upgrade before you create new cluster 
resources. See Section 7.3, “Requirements and Guidelines for Upgrading Clusters from OES 2 SP3,” 
on page 108. 


NCP File Access with Novell NCP Server 


Novell NCP Server can be used to provide NCP file access to Linux POSIX file systems on OES 11 
and later servers. Its NCP volumes feature can be used to provide NCP access to files on an LVM 
volume group cluster resource. NCP Server must be installed, configured, and running on each node 
in the cluster. 


+ “Naming Conventions for NCP Volumes” on page 329 

+ “Creating an NCP Volume for a New Clustered LVM Volume” on page 329 

+ “Creating an NCP Volume on an Existing Clustered LVM Volume” on page 329 
+ “Using Antivirus Software with NCP Volumes” on page 330 


Naming Conventions for NCP Volumes 


NCP volume names can be up to 14 alphanumeric characters, using uppercase letters A through Z 
and numbers 0 through 9. Underscores (_) are allowed. 


If you NCP enable a Linux volume as you create it with NSSMU or the nlvm create linux volume 
command, the NCP volume name uses the specified Linux volume name, but all letters are 
uppercase. NCP treats the Linux volume name as case insensitive. Ensure that the specified Linux 
volume name does not exceed 14 characters, does not use special characters, and is unique across 
all nodes in the cluster for both Linux and NCP. 


Creating an NCP Volume for a New Clustered LVM Volume 


You can configure NCP file access for an LVM volume group cluster resource when you create the 
resource by using NSSMU or the nlvm create linux volume command. With the NCP option 
enabled, these tools automatically add commands to the resource scripts that mount, dismount, and 
monitor an NCP volume. The NCP volume is named the same as the LVM logical volume name, and 
all letters in the name are uppercase. The tools automatically create an NCP Virtual Server object for 
the volume group cluster resource. 


Creating an NCP Volume on an Existing Clustered LVM Volume 


You can create an NCP Virtual Server object for the LVM cluster resource to make the resource 
visible in the eDirectory tree. The virtual server alone does not provide NCP file access. 


You can add NCP file access support to an existing LVM cluster resource by creating an NCP Volume 
object and adding commands to the scripts to manage the volume. For details about setting up NCP 
volumes on an existing clustered Linux volume, see “Configuring NCP Volumes with Novell Cluster 
Services” in the OES 11 SP3: NCP Server for Linux Administration Guide. 
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13.1.9 


13.1.10 


13.2 


Using Antivirus Software with NCP Volumes 


For information about using antivirus software with NCP volumes, see “Security” in the OES 11 SP3: 
Planning and Implementation Guide. 


SMBICIFS File Access with Novell Samba 


Samba is an open source software suite that lets Linux and other non-Windows servers provide file 
and print services to clients that support the Microsoft SMB (Server Message Block) and CIFS 
(Common Internet File System) protocols. Novell Samba is the Linux Samba software that has been 
modified to work with NetIQ eDirectory. 


Novell Samba can be used to provide SMB/CIFS access to files on an LVM volume group cluster 
resource for eDirectory users who are enabled for Linux User Management (LUM). For information 
about LUM-enabling your eDirectory users, see the OES 11 SP3: Novell Linux User Management 
Administration Guide. 


Novell Samba must be installed and configured on each node in the cluster. The cluster load script 
starts the service when you online the Samba cluster resource, and the unload script stops the 
service when you offline it. For information about using the Samba resource template to create a 
Samba cluster resource that is based on an LVM volume group, see “Configuring Samba for LVM 
Volume Groups and Novell Cluster Services” in the OES 11 SP3: Novell Samba Administration 
Guide. 


IMPORTANT: If you enable both NCP and Novell Samba file access for users, we recommend that 
you enable the Cross-Protocol Lock (CPL) parameter for NCP Server. CPL helps prevent potential 
data corruption when files are accessed by non-NCP file access protocols and by other applications 
that directly access the files with POSIX APIs. CPL is enabled by default. See “Configuring Cross- 
Protocol File Locks for NCP Server” in the OES 11 SP3: NCP Server for Linux Administration Guide. 


Linux File Access Protocols 


You can provide native Linux file access to files on an LVM volume group cluster resource for 
eDirectory users who are enabled for Linux User Management (LUM). The Linux file access protocols 
must also be LUM enabled on each node of the cluster. For information about LUM-enabling your 
eDirectory users and native Linux file access protocols, see the OES 11 SP3: Novell Linux User 
Management Administration Guide. 


Initializing a SAN Device 


Before you begin, you must initialize the SAN device to set up its device format. You can also initialize 
a device to wipe its current structure and reconfigure it. 


WARNING: Initializing a device removes all partitions and data from the device. Do not initialize the 
device that contains the operating system. 


Devices that you want to use for a clustered Linux LVM volume group should contain no partitions 
and be in an unshared state. When you initialize the SAN device by using NSS management tools, 
ensure that the Shareable for Clustering option is disabled. CLVM handles the sharing for clustered 
LVM volumes. 
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13.2.1 


IMPORTANT: NLVM and NSSMU do not support using Linux software RAID devices and NSS 
software RAID devices with Linux POSIX file systems. You can use a hardware RAID device to 
achieve device fault tolerance for Linux POSIX volumes. 


Initializing a device formats it with an MSDOS or a GPT partitioning scheme. MSDOS supports 
devices up to 2 TB in size. GPT supports devices of any size. The default is MSDOS. If the device 
size is greater than 2 TB and the partitioning scheme is not specified, the default partitioning scheme 
of MSDOS applies, and the device size is truncated to 2 TB with the remainder as unusable space. 


Devices that have never been initialized have a format of None (NLVM commands) or Uninitialized 
(in NSSMU). Devices that are being used for a Novell Cluster Services SBD (split brain detector) 
partition also have a format of None. You should not use the nlvm init command to remove an SBD 
partition. For information about removing an SBD partition, see Section 9.18, “Creating or Deleting 
Cluster SBD Partitions,” on page 173. 


Use either procedure in this section to initialize the SAN device that you want to use for the LVM 
volume group. Do not mark it as shareable for clustering. 


¢ Section 13.2.1, “Using NSSMU to Initialize a Device,” on page 331 
¢ Section 13.2.2, “Using NLVM Commands to Initialize a Device,” on page 333 


Using NSSMU to Initialize a Device 


1 Ensure that the SAN device is attached to all of the nodes in the cluster. 
2 Log in as the root user to the master node of the cluster, then open a terminal console. 
3 Launch NSSMU: 


nssmu 


4 Inthe NSSMU main menu, select Devices, then press Enter. 


' 


5 Inthe Devices list, select the SAN device (such as sdf), then view information about it. 


A device that has never been initialized reports a partition type of Uninitialized. If the device 
contains partitions or data, be prepared to lose all data on the device when it is initialized. The 
clustered volume group requires the entire device. 
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6 Press F3 to initialize the selected device. 


You are prompted to confirm the initialization. If you continue, any existing partitions on the 
device are deleted, and a new partition table is created. 


7 Read the advisory message, then do one of the following: 
+ Press y (Yes) to confirm that you want to initialize the device, and continue to Step 8. 
+ Press n (No) (or press Esc) to cancel. Return to Step 5 and choose a different device. 
8 Specify the partitioning scheme to use as DOS or GPT, then press Enter. 
DOS supports devices up to 2 TB in size. GPT supports devices of any size. 
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9 Select the device and view its details to verify that the device is initialized and unshared (that is, 
Shareable for Clustering is set to No.) If Shareable for Clustering is set to Yes, press F6 to 
unshare the device. 


This ensures there are no partitions on the device, and the entire device is available to Clustered 
LVM (CLVM). In OES 11 SP2 and later, if the device is shared but it contains no other partitions, 
NSSMU and NLVM will automatically clear the shared setting and use the entire device. 


Information 


F3=Init F5=Refresh F6=Share SPACE=Select/Unselect F8=More 


10 Press Esc twice to exit NSSMU. 


13.2.2 Using NLVM Commands to Initialize a Device 


1 Ensure that the SAN device is attached to all of the nodes in the cluster. 
2 Log in as the root user to the master node of the cluster, then open a terminal console. 
3 At the command prompt, enter 


nlvm [--force] [--no-prompt] init <device name> format=<gpt|msdos> unshared 


Replace device_name with the device node name of the device to be initialized, such as sdf. 
This must be the first command option to follow init. 


Specify the partitioning scheme as gpt or msdos. The default is msdos. 
Specify the unshared option to ensure that the device is not marked as shareable for clustering. 
You can specify the -- force NLVM option to force the initialization. 


You are automatically prompted to confirm the initialize action. Respond by pressing y (Yes) or n 
(No). You can use the --no-prompt NLVM option to suppress the confirmation. 


For example, enter 
nlvm init sdf format=gpt unshared 

4 Confirm that the device was initialized and is unshared. At the command prompt, enter 
nlvm list device <device_ name> 


Replace device_name with the device node name of the device that you initialized, such as sdf. 


The command returns information about the device, such as its major:minor number, device 
size, partitioning format, and whether the device is shared. 


For example, enter 
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nivm list device sdf 


avalon:~/Desktop # nlvm list device sdf 

Name=sdf 
Size=512. 00MB( 1048576) Used=32KB(64) Free=511.95MB( 1048479) 
Format=GPT Shared=No RAID=No M:M=8:80 H:S=255:32 


13.3 Configuring an LVM Volume Group Cluster 
Resource with NSS Management Tools 


This section describes how to use the NSSMU utility and NLVM commands to create a clustered LVM 
volume group and logical volume on a single SAN device that is assigned to all nodes in the cluster. 
The volume is exclusively mounted on only one node at a time. Clustered LVM manages the locks for 
the exclusive mount. 


After you create the resource, you should view and modify the cluster resource settings and scripts 
before you bring the resource online. You can also add lines to its load script, unload script, and 
monitor script to customize the resource for other uses. 


If you enable NCP when you create the LVM volume group in NSSMU or with nivm commands, 
commands are automatically added to the resource scripts to mount, dismount, and monitor an NCP 
volume. The NCP volume is named the same as the LVM logical volume name, and all letters in the 
name are uppercase. An NCP Virtual Server object is created for the resource and commands are 
added to the scripts to bind or unbind it with the resource IP address. 

¢ Section 13.3.1, “Sample Values,” on page 334 

¢ Section 13.3.2, “Creating an LVM Volume Group Cluster Resource with NSSMU,” on page 336 


¢ Section 13.3.3, “Creating an LVM Volume Group Cluster Resource with NLVM Commands,” on 
page 341 


¢ Section 13.3.4, “Configuring the LVM Cluster Resource Settings,” on page 344 
¢ Section 13.3.5, “Viewing or Modifying the LVM Resource Scripts,” on page 347 
¢ Section 13.3.6, “Sample LVM Resource Scripts,” on page 349 


13.3.1 Sample Values 


The configuration scenarios use following sample values. Ensure that you replace the sample values 
with information for your configuration. 
Parameter Sample Value 


Device name for the shared SAN device /dev/sdf 


The device is initialized and contains no partitions. It is not enabled 
as shareable for clustering. 


Volume group name vol44 


By default, NSSMU uses the logical volume name as the LVM 
volume group name. If you use the NLVM create linux volume 
command to create the LVM volume group cluster resource, you 
can specify a different name for the volume group, such as vg44. 
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Parameter Sample Value 


Volume name vol44 


If you enable NCP for the volume, this name must comply with the 
“Naming Conventions for NCP Volumes” on page 329. Lowercase 
letters are automatically changed to uppercase for the NCP volume 
name. 


NCP volume name VOL44 


The NCP volume is created only if you enable NCP as you create 
the clustered LVM volume by using NSSMU or the NLVM create 
linux volume command. 


The mount point path for the NCP volume is the mount point for the 
LVM volume. This means that the NCP share is created at the root 
of the mounted LVM volume when the LVM resource is online. 


Linux POSIX file system type ext3 


Valid values are btrfs (requires the btrfsprogs package), ext2, 
ext3, reiserfs, and xfs. 


Make options for the file system None (do not specify a value). Press Enter to continue. 


For a list of the supported file system options for the file system type 
you are making, see the mkfs (8) man page and the man page for 
the specific file system: mkfs.btrfs (8), mkfs.ext2(8), 
mkfs.ext3 (8), mkfs.reiserfs(8), Of mkfs.xfs(8). 


IMPORTANT: The file system creation fails if you specify a make 
option that is not supported by the file system type. 


Mount options rw 


The Read/Write (rw) option is specified by default. For a list of 
available options that work with the file system type you are using, 
see the mount (8) man page. 


Volume size 100 GB 


A 100 GB LUN is prepared in the shared storage subsystem. It is 
attached to the nodes in the cluster. The device must be initialized 
and contain no partitions. It should not be marked as Shareable for 
clustering. 


You are not prompted to enter a volume size. The clustered LVM 
volume group and logical volume use the entire device. When you 
select the device, all of the device’s free available space is 
displayed in the Free Size field. 


Resource IP address 10.10.10.44 


This is the IP address of the virtual server for the cluster resource. 
The address must be unique and in the same subnet as the cluster’s 
IP address. Specify the IP address in IPv4 format. 
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Parameter Sample Value 


Mount device /dev/vol44/vol44 
The mount device path format is 
/dev/<volume_group_name>/<logical_volume_name> 


If you specify a different name for the volume group, such as vg44, 
by using the NLVM create linux volume command, the mount 
device path is /dev/vg44/vol44. 


Mount point path /mnt /vol44 


You can use any valid Linux path as the mount point. The default 
mount point location for LVM logical volumes created by NSSMU 
and NLVM is /usr/novell/<1x_volume_name>. 


NSSMU automatically creates the mount point path if it does not 
exist on this node. However, you must manually create the mount 
point on each of the other nodes in the cluster. If the path does not 
exist on a node when you fail over the resource to it, the resource 
goes comatose You can alternatively add the following line to the 
load script before the Linux file system mount command to create 
the path on a node if it does not exist: 


ignore _error mkdir -p SMOUNT_PATH 


13.3.2 Creating an LVM Volume Group Cluster Resource with 
NSSMU 


This section describes how to use NSSMU to create and cluster-enable an LVM volume group. 
NSSMU automatically uses the same script format as the Generic File System template 
(Generic FS Template) to create an LVM volume group cluster resource. 

1 Ensure that the SAN device is attached to all of the nodes in the cluster. 

2 Log in as the root user to the master node of the cluster, then open a terminal console. 


3 If you have not already done so, initialize the SAN device that you want to use for the LVM 
volume group. 


LVM allows only one device per volume group. See Section 13.2, “Initializing a SAN Device,” on 
page 330. 


4 Launch NSSMU: 
nssmu 


5 Inthe NSSMU main menu, select Linux Volumes, then press Enter. 
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6 On the Linux Volumes page, press Insert to launch the volume creation wizard, then enter the 
following information as you are prompted for it: 


Parameter 


Select LVM type 


Action 


Select Cluster Enabled LVM2 Volume, then press Enter. 


ect LVM type 


wCLuster Enabled LVM2 Volume 


NCP Enable volume? 


Specify whether to enable the LVM logical volume for NCP file access. Press 
y (yes) to allow NCP file access, or press n (No) to disallow NCP file access 
at this time. 


If you enable NCP, NSSMU automatically adds commands to the resource 
scripts that mount, dismount, and monitor an NCP volume. The NCP volume 
is named the same as the LVM logical volume name, and all letters in the 
name are uppercase. The tools automatically create an NCP Virtual Server 
object for the resource. 


If you do not enable NCP at this time, you can manually create an NCP virtual 
server, create an NCP Volume object, and add NCP commands to the scripts. 
See Section 13.5, “Creating a Virtual Server Object for an LVM Volume 
Group Cluster Resource,” on page 367. 


Enter volume name 


Type the name for the LVM logical volume (Such as vo144), then press Enter. 


Enter volume name: TICE | 


The specified name is also used for the LVM volume group, which is used in 
the name of the LVM volume group cluster resource. 


If you enable NCP for the volume, the specified name is also applied to the 
NCP volume. An NCP volume name can be up to 14 alphanumeric 
characters. Underscores are allowed. All letters in the LVM volume name are 
uppercase for the NCP volume name. For example, if the LVM volume name 
is vol44, the NCP volume name is VOL44. 


Enter volume IP address 
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Type the IP address to use for the LVM cluster resource in IPv4 format (Such 
as 10.10.10.44), then press Enter. 


Enter volume ip address: 10.10.10.44ff 


337 


Parameter Action 


Select Volume type Select one of the following the Linux POSIX file systems, then press Enter: 
+ btrfs 
This option is displayed only if the btrfsprogs package is installed. 
+ ext2 
* ext3 
+ resiserfs 


+ xfs 


Enter full mount point Type the full mount point path for the LVM logical volume (such as /mnt/ 
path vol44), then press Enter. 


Enter full mountpoint path: Jusr/novell/vol44 


The default path is /usr/novell/<1x_volume_name>, such as /usr/ 
novell/vol44. 


If NCP is enabled, the specified path is also used as the mount point path for 
the NCP volume. 


Enter any make options Press Enter to continue without specifying options, or specify the desired 
make options for the file system type you are making, then press Enter. 


Enter any make options: 


For a list of the supported file system options for the file system type you are 
making, see the mkfs (8) man page and the man page for the specific file 
system: mkfs.btrfs(8), mkfs.ext2 (8), mkfs.ext3(8), 
mkfs.reiserfs(8), Or mkfs.xfs(8). 


IMPORTANT: The file system creation fails if you specify a make option that 
is not supported by the specified file system type. 


Enter any mount options Press Enter to accept the default read and write options (rw). 


Enter any mount options: ie 


The Read/Write (rw) option is specified by default. You can add other mount 
options, or modify this option. For a list of available options that work with the 
specified file system type, see the mount (8) man page. 
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Parameter Action 


Device From the list of available devices, select the device that you initialized in 
Section 13.2, “Initializing a SAN Device,” on page 330, such as sdf, then 
press Insert or Enter to select the device. 


The LVM volume group requires the entire device. You cannot specify the 
amount of space to use. The device’s free available space is displayed in the 
Free Size field. 


7 Press F3 to accept the setup you entered for the volume group cluster resource. 


The resource is created and brought online on the node where you created it. The resource is 
named <volume_group_name> resource. In the example, the name of the volume group is the 
same as the logical volume, so the resource name is vol44_resource. 


Typically, the volume creation takes less than 10 seconds. However, if you have a large tree or if 
the server does not hold an eDirectory replica, the create time can take up to 3 minutes. 


8 In the Linux Volumes list, select the newly created volume and view information about it. 
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Parameter Description 
Device Specifies the full device node path for the LVM logical volume. 
Example: /dev/vol44/vol44 
Mount Point When the resource is online, this specifies the path on the root file system 


where this volume is mounted. 


Example: /mnt/vol44 


Mount options 


When the resource is online, this specifies the mount options that are applied 
whenever this volume is automatically mounted after a reboot. 


Example: rw 


Type When the resource is online, this specifies the file system type. 
Examples: btrfs, ext2, ext3, reiserfs, xfs 

Size Specifies the amount of space reserved for this volume. 
Example: 99.58 GB 

Mounted Specifies whether the volume is mounted or unmounted. When the resource is 
brought online, the load script mounts the logical volume. 
Value: Yes or No 

State Specifies the availability for the file system. 
Example: Read/Write 

LVM Specifies whether the specified volume is an LVM logical volume. 
Value: Yes 

NCP Specifies whether the LVM logical volume is enabled for NCP. 


The NCP state cannot be determined for a clustered LVM volume. You can use 
the Clusters plug-in for iManager to determine if there are NCP commands in 
the load script. On the Cluster Options page, select the resource to view its 
properties, then click the Scripts tab. 


Share State 


Specifies whether the LVM logical volume is cluster enabled for a Novell 
Cluster Services cluster. 


Value: Shareable for Clustering 


When an LVM logical volume group is clustered, CLVM manages the share 
state, not the device. NSSMU reports the device as Not Shareable for 
Clustering. NSSMU reports the clustered LVM volume is Shareable for 
Clustering. 


9 Press Escape twice to exit NSSMU. 
10 Continue with Section 13.3.4, “Configuring the LVM Cluster Resource Settings,” on page 344. 
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13.3.3 


Creating an LVM Volume Group Cluster Resource with 
NLVM Commands 


This section describes how to use NLVM commands to create and cluster-enable an LVM volume 


group. NLVM automatically uses the same script format as the Generic File System template 


(Generic FS Template) to create an LVM volume group cluster resource. The NLVM command 


allows you to specify a group name that is different than the volume name. 


1 Ensure that the SAN device is attached to all of the nodes in the cluster. 
2 Log in to the master node of the cluster as the root user, then open a terminal console. 


3 If you have not already done so, initialize the SAN device that you want to use for the LVM 
volume group. 


See Section 13.2, “Initializing a SAN Device,” on page 330. 


4 Create a clustered LVM volume group and logical volume. At the command prompt, enter the 


following (all on the same line, of course): 


nlvm [nlvm_options] create linux volume 
type=<btrfs|ext2|ext3|reiserfs|xfs> 
device=<device_name> 
[mp=</mount_path>] 


[mkopt=<optionl[,option2,...]>] 
[mntopt=<optionl [option2[]...]>] 
lvm 


name=<lvm_volume_name> 

[group=<lvm_group_name>] 

shared 

ip=<IP_address_for_LVM _volgroup_cluster_resource> 
[ncp] 


For details about using this command, see “Create Linux Volume” in the OES 11 SP3: NLVM 


Reference. 
Parameters and Options 
type=<btrfs|ext2|ext3|reiserfs|xfs> 
You must specify the type of file system to use for the volume. Btrfs requires that the 


btrfsprogs package is installed on all nodes. Supported file systems are btrfs, ext2, ext3, 


reiserfs, and xfs. 
device=<device_name> 


You must specify the device to use. Replace device_name with the device node name of 


the device that you want to use for the volume, such as sdf. The entire device is used for 


the LVM volume group. You cannot specify a size to use. The device must already be 
initialized, contain no partitions, and must not be marked as shareable for clustering. 


[mp=</mount_path>] 


If a mount point path is not specified, the utility assigns a default mount path of /usr/ 
novell/<volume_name>. Use the mp option to specify a custom mount point. Replace 


mount_path with the full Linux path of the mount point where the volume is to be mounted. 
The final directory name in the path can be the same or different than the specified volume 
name. If the path does not currently exist, it is automatically created on that node. You must 


manually create the path on other nodes in the cluster. 
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[mkopt=<option1[,option2,...]>] 


You can use the mkopt option to specify the options to use when running mk£fs. For a list of 
available options, see the mkfs (8) man page. No default option is specified. For a list of the 
supported file system options for the file system type you are making, see the mkfs (8) man 
page and the man page for the specific file system: mkfs.btrfs (8), mkfs.ext2 (8), 
mkfs.ext3 (8), mkfs.reiserfs(8), Of mkfs.xfs(8). 


IMPORTANT: The file system creation fails if you specify a make option that is not 
supported by the file system type. 


[mntopt=<option1[option2[]...]>] 


You can use the mntopt option to specify the options to use when mounting the volume. For 
a list of available options, see the mount (8) man page. The default mmtopt value is rw 
(Read/Write). 


Ivm 


You must specify the 1vm option to create an LVM volume group and logical volume. Use 
this option with the name option. 


name=</vm_volume_name> 


Replace /vm_volume_name with a name for the LVM volume. If you do not specify the 
group option, this name is also used as the LVM volume group name, which is used in the 
cluster resource name. For LVM logical volume naming conventions, see “Linux LVM 
Volume Group and Logical Volume Names” in the OES 11 SP3: NLVM Reference. 


If you use the NCP option, the NCP volume name uses the same name as the LVM logical 
volume name, but all letters are uppercase. NCP volume names can be up to 14 
alphanumeric characters, and underscores are allowed. 


[group=</vm_group_name>] 


Replace /vm_volume_group_name with a name for the LVM volume group. The group 
name is also used in the cluster resource name. If you do not specify a volume group name, 
the group is automatically named the same as the LVM volume. 


shared 


You must specify the shared option to create a clustered LVM volume group and logical 
volume. 


ip=</P_address_for_LVM_volgroup_cluster_resource> 


Replace /P_address_for_LVM_volgroup_cluster_resource with a static unique IP address 
to use for the LVM cluster resource. Specify the address in IPv4 format. 


ncp 
Specify the ncp option to NCP enable the LVM logical volume for NCP file access. 


+ If you enable NCP, NSSMU automatically adds commands to the resource scripts that 
mount, dismount, and monitor an NCP volume. The NCP volume is named the same 
as the LVM logical volume name, and all letters in the name are uppercase. The tools 
automatically create an NCP Virtual Server object for the resource. 


+ If you do not enable NCP at this time, you can manually create a virtual server and add 
NCP file access later. See Section 13.5, “Creating a Virtual Server Object for an LVM 
Volume Group Cluster Resource,” on page 367. 
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Example For example, at the command prompt, enter the following (all on the same line): 


nlvm create linux volume 
type=ext3 
device=sdf 
mp=/mnt/vol44 
mntopt=rw 
lvm 
name=vol44 
group=vg44 
shared 
ip=10.10.10.44 
ncp 


If the command is successful, the response is 
Linux clustered volume vol44 created. 


Typically, the volume creation takes less than 10 seconds. However, if you have a large tree or if 
the server does not hold an eDirectory replica, the create time can take up to 3 minutes. 


5 Verify that the cluster resource was created and brought online by entering 
cluster status 


The resource is named </v_name>_resource. In the following example, vol44_resource is in 
the Running state. 


avalon:~/Desktop # cluster status 


Master_IP_Address Resource Running avalon 1 
lvmvol134_resource Running avalon 1 
ol44 resource Running avalon 1 


6 View the device information to see that the device shows the LVM format. At the command 
prompt, enter 


nlvm list device <device_ name> 


Replace device_name with the name of the device that you used, such as sdf. 


The command shows that the LVM container uses the entire device; the size and used space 
values are the same and the free space shows no space. The partitioning format is LVM. 


For example, enter 


nlvm list device sdf 
avalon: ~/Desktop # nlvm list device sdf 
Name=sdf 


S1ze=512.00MB(1048576) Used=512.00MB(1048576) Free=O0KB(0) 
Format=LVM Shared=No RAID=No M:M=8:64 H:S=255:32 


7 Continue with Section 13.3.4, “Configuring the LVM Cluster Resource Settings,” on page 344. 
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13.3.4 


Configuring the LVM Cluster Resource Settings 


After you create a clustered LVM volume group and logical volume, use the procedure in this section 
to verify that the LVM volume group cluster resource was created and is online. You can customize 
the resource policies, monitoring, and preferred nodes settings. 

1 Open Novell iManager in a web browser, then log in as a cluster administrator user. 

2 In Roles and Tasks, select Clusters > My Clusters. 


3 Select the cluster where you created the volume group cluster resource. 


If the cluster you want to manage is not in the list, you can add it. Click Add, browse to locate 
and select the Cluster object of the cluster, then click OK. 


In the list of resources, locate the new resource, such as vol44_resource, and notice the state 
of the resource. It should be online and running. 


My Clusters > clus! .ncs.nove 
® clust.ncs.novell e 


View the status of both s 
to offline or 


f Cluster Manager \ GOTT BCC Manager \ Cluster Event Log \ Cluster Options 


__ Run Report _| 


arces to different servers in the cluster, or change the state 


1s and resources in the cluster. You can also migrate cluster 1 


Epoch: 0 


avalon 


Online | Offline | Migrate | RespondtoAlert | Refreshw 2 Item(s) 
CO Type B| Name State Location Lives Up Since 
O & Master_IP_Address_Resource @ Running avalon 1 Aug 8, 2012 10:01:33 AM 
O @ vols4 resource @ Running avalon 1 
Close 


Click the resource’s name link to open its Properties page. 


You can alternatively go to the Cluster Options page, then click the resource’s name link, or 
select the check box next to the resource and click Details. 
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6 On the Resource Policies page, view and modify the resource’s Policy settings if needed. Click 
Apply if you make changes. 


My Clusters > clus1 .ncs.novell 


K 


&æ vol44_resource 


Monitoring \ Preferred Nodes \ Scripts \ Business Continuity 


Set Start, Failover and Failback modes 
resource will not take affect until the re 


ource. Changes other than business continuity changes made to a 


Failover Mode 
C Resource Follows Master @ Auto 
CO Ignore Quorum © Manual 
Start Mode Failback Mode 
@ Auto O Auto 
D Manual @® Disable 
) Manual 
OK | Cancel |  Aappy | 


6a (Optional) Select the Resource Follows Master check box if you want to ensure that the 
resource runs only on the master node in the cluster. 


If the master node in the cluster fails, the resource fails over to the node that becomes the 
master. 


6b (Optional) Select the Ignore Quorum check box if you don’t want the cluster-wide timeout 
period and node number limit enforced. 


The quorum default values were set when you installed Novell Cluster Services. You can 
change the quorum default values by accessing the properties page for the Cluster object. 


Selecting this box ensures that the resource is launched immediately on any server in the 
Preferred Nodes list as soon as any server in the list is brought online. 


6c By default, the Generic File System resource template sets the Start mode and Failover 
mode to Auto and the Failback Mode to Disable. You can change the default settings as 
needed. 


¢ Start Mode: If the Start mode is set to Auto, the resource automatically loads on a 
designated server when the cluster is first brought up. If the Start mode is set to 
Manual, you can manually start the resource on a specific server when you want, 
instead of having it automatically start when servers in the cluster are brought up. 


¢ Failover Mode: If the Failover mode is set to Auto, the resource automatically moves 
to the next server in the Preferred Nodes list if there is a hardware or software failure. If 
the Failover mode is set to Manual, you can intervene after a failure occurs and before 
the resource is started on another node. 


¢ Failback Mode: If the Failback mode is set to Disable, the resource continues running 
on the node it has failed to. If the Failback mode is set to Auto, the resource 
automatically moves back to its preferred node when the preferred node is brought 
back online. Set the Failback mode to Manual to prevent the resource from moving 
back to its preferred node when that node is brought back online, until you are ready to 
allow it to happen. 
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7 Enable and configure monitoring for the resource, then click Apply. 
See Section 10.7, “Enabling Monitoring and Configuring the Monitor Script,” on page 208. 


My Clusters > clus! .ncs.novell 0l44_resource 


# vol44_resource ? 


Policies Preferred Nodes \ Scripts \ Business Continuity 

e monitor 
he maximum 
t until the res 


health the interval t 


starts. Changes ot 


her than busin: 


|) Enable Resource Monitoring 


Polling Interval 1 | Minutes ¢ | 


Failure Rate 


Maximum Local Failures: {3 | 


Time Interval fio || Minutes £ | 


(Example: 3 Failures in 5 minutes) 
Failure Action 
Ifthe Failure rate settings are reached, perform the following action 
@  SetResource as Comatose 
Migrate the Resource based on the Preferred Nodes List 


Reboot the Hosting Node without Syncing or Unmounting Disks 


7a Inthe Properties page, select the Monitoring tab. 


7b Select the Enable Resource Monitoring check box to enable resource monitoring for the 
selected resource. 


Resource monitoring is disabled by default. 


7c Specify the Polling Interval to control how often you want the resource monitor script for this 
resource to run. 


You can specify the value in minutes or seconds. See “Polling Interval” on page 209. 


7d Specify the number of failures (Maximum Local Failures) for the specified amount of time 
(Time Interval). 


See “Failure Rate” on page 209. 


7e Specify the Failover Action by indicating whether you want the resource to be set toa 
comatose state, to migrate to another server, or to reboot the hosting node (without 
synchronizing or unmounting the disks) if a failure action initiates. The reboot option is 
normally used only for a mission-critical cluster resource that must remain available. 


See “Failure Action” on page 209. 


8 Click the Preferred Nodes tab, assign preferred nodes for the resource by moving them from the 
Unassigned list to the Assigned list, then click Apply. 


When you configure a volume group cluster resource with NSSMU or with NLVM commands, the 
node where you create it is automatically assigned as a preferred node for the resource. 


IMPORTANT: For Assigned nodes, ensure that you prepare the node for the services in the 
resource before you migrate or fail over the resource to it. 
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13.3.5 


When you bring a resource online, it is automatically loaded on the most preferred node in the 
list. If the node is not available, the other nodes are tried in the order that they appear in the list. 
You can modify the order of the nodes by clicking the Edit (pen) icon to open the list in a text 
editor. In the editor, click OK to close the editor, then click Apply to save your changes. 


My Clusters > clus! .ncs.novell > vold4_resource 


æ vol44_resource ? 


Policies \ Monitoring A yE EAER Scripts \ Protocols \ Business Continuity 


View or change the preferred nodes for this cluster resource. 


Assigned: Unassigned: 
avalon a] dorset 
newcastle fairfax 
london brighton 

merrifield 
Le) 
4 
À E 
OK | Cancel | Apply | 


9 At the bottom of the page, click OK to close the Properties page and save your changes. 
The changes do not take effect until the resource is taken offline and brought online again. 
10 Continue with Section 13.3.5, “Viewing or Modifying the LVM Resource Scripts,” on page 347. 


Viewing or Modifying the LVM Resource Scripts 


You can customize the scripts by adding lines for other products that use a shared LVM volume group 


resource. Compare the generic script with the templates for those products to identify what lines need 
to be added or modified. 


1 In iManager, select Clusters > My Clusters. 

2 Select the cluster where you created the volume group cluster resource. 
Select the cluster resource’s name link to open the Properties page, then click the Scripts tab. 
The Scripts tab automatically opens to the load script. 

4 On the Load Script page, view or modify the load script. Click Apply if you make changes. 


Ensure that all letters in the NCP volume name are uppercase letters A to Z. See the “Sample 
LVM Resource Load Scripts Created by NSS Management Tools” on page 350. 
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My Clusters > clust .ncs.novell > vol44_resource 


# vol44_resource 


Policies \ Monitoring \ Preferred Nodes Business Continuity \ 


Load Script | Unload Script | Monitor Script 


View or edit the load script for this cluster resource. Changes other than business continuity changes made to a resource will 
not take affect until the resource is reloaded 


Script: 
MOUNT_FS=ext3 
#define the volume group name 


VOLGROUP_NAME=v0144 


# define the device 


NCP_SERVER=clus1-vol44- SERVER 
# define NCP volume name 
NCP_VOLUME=VOL 44) 


# activate the volume group 


exit_on_error vachange -a ey $VOLGROUP NAME 


Timeout: |6 | Minutes o 


OK Cancel Apply 


5 Click the Unload Script link to view or modify the unload script. Click Apply if you make changes. 


Ensure that all letters in the NCP volume name are uppercase letters A to Z. See the “Sample 
LVM Resource Unload Scripts Created by NSS Management Tools” on page 351. 


My Clusters > clus! ncs.novell > vold4_jesource 


# vol44_resource [2] 
Policies \ Monitoring \ Preferred Nodes Business Continuity | 


Load Script | Unload Script | Monitor Script 


View or edit the unload script for this cluster resource. Changes other than business continuity changes made to a resource will 
not take affect until the resource is reloaded. 


Script: 

RESOURCE_IP= 10.10.10.44 

# define the file system type 

MOUNT_FS=ext3 

#define the volume group name 
IP_NAME=v0l44 

# define the device 

MOUNT_DEV=/dey/vol44/vol44 

# define the mount point 

MOUNT_POINT=/usr/noyell/vol44 

# define NCP server name 

NCP_SERVER=c lus1-vol44- SERVER 

# define NCP volume name 

NCP_VOLUME=VOL 44] 


ignore_error ncpcon unbind --ncpservername=$NCP_ SERVER --ipaddress=$RE 


Timeout: |6 || Minutes |© | 


0K | Cancel | Apply | 


6 Click the Monitor Script link to view or modify the monitor script. Click Apply if you make 
changes. 


Ensure that all letters in the NCP volume name are uppercase letters A to Z. See the “Sample 
LVM Resource Monitor Scripts Created by NSS Management Tools” on page 352. 
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My Clusters > clus1 .ncs.novell 44_tesource 


# vol44_resource 2 


Policies \ Monitoring \ Preferred Nodes Business Continuity 


Load Script | Unload Script | Monitor Script 


View or edit the monitor script for this cluster resource. Changes other than business continuity changes made to a resource 
will not take affect until the resource is reloaded. 


Script 
# define the file system type a 
MOUNT_FS=ext3 

#define the volume group name 
VOLGROUP_NAME=v0l44 

# define the device 
MOUNT_DEV=/dey/vol44/vol44 

# define the mount point 
MOUNT_POINT=/usr/novell/vol44 
# define NCP server name 
NCP_SERVER=c Lus1-vo144-SERVER 
# define NCP volume name 
NCP_VOLUME=VOL44| 


# check the IP address 
ignore_error status_secondary_ipaddress $RESOURCE_IP xj 


Timeout: |6 | | Minutes Sj 


OK | Cancel | Apply | 


7 At the bottom of the page, click OK to close the Properties page and save your changes. 
The changes do not take effect until the resource is taken offline and brought online again. 


8 If you modified the settings on any of the pages, you must take the resource offline and bring it 
online in order for the changes to take effect. 


8a In Roles and Tasks, select Clusters > My Clusters. 

8b On the Cluster Manager page, select the check box next to the resource, then click Offline. 
Wait for the status to report that it is offline, then continue. 

8c Select the check box next to the resource, then click Online. 

8d Verify that the resource comes online and reports a Running state. 


If the resource goes into a Comatose state, it is probably because you made a mistake in 
the lines you added or modified in the scripts. Take the resource offline, then go back to 
correct the scripts, and try to bring it online again. 


Sample LVM Resource Scripts 


The sample LVM resource scripts in this section are automatically generated for an LVM volume 
group cluster resource when you use NLVM or NSSMU to create a clustered LVM2 volume, as 
described in Section 13.3, “Configuring an LVM Volume Group Cluster Resource with NSS 
Management Tools,” on page 334. See Section 13.3.1, “Sample Values,” on page 334 for information 
about the sample values used in these scripts. Ensure that you replace sample values with those for 
your own system. 


¢ “Sample LVM Resource Load Scripts Created by NSS Management Tools” on page 350 
¢ “Sample LVM Resource Unload Scripts Created by NSS Management Tools” on page 351 
¢ “Sample LVM Resource Monitor Scripts Created by NSS Management Tools” on page 352 
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Sample LVM Resource Load Scripts Created by NSS Management 
Tools 


Compare the load scripts in this section to identify the lines that are added when you enable the LVM 
logical volume for NCP file access: 


+ “Without NCP File Access” on page 350 
+ “With NCP File Access” on page 350 


Without NCP File Access 


!/bin/bash 
/opt/novell/ncs/lib/nesfuncs 


define the IP address 

RESOURCE _IP=10.10.10.44 

define the file system type 

MOUNT_FS=ext3 

define the volume group name (nssmu uses volume name for group name) 
VOLGROUP_NAME=vol44 

define the device 

MOUNT_DEV=/dev/$VOLGROUP_NAME/vol44 

define the mount point 

MOUNT_POINT=/mnt/vol44 


activate the volume group 
exit_on_error vgchange -a ey $VOLGROUP_NAME 


create the mount point if it does not exist on the node 
ignore _error mkdir -p SMOUNT_POINT 


mount the file system 
exit_on_error mount_fs S$MOUNT_DEV $MOUNT_POINT S$MOUNT_FS 


add the IP address 
exit_on error add_secondary_ipaddress $RESOURCE_IP 


exit 0 


With NCP File Access 


!/bin/bash 
/opt /novell/ncs/lib/ncsfuncs 


define the IP address 

RESOURCE _IP=10.10.10.44 

define the file system type 

MOUNT_FS=ext3 

define the volume group name (nssmu uses volume name for group name) 
VOLGROUP_NAME=vol44 

define the device 

MOUNT_DEV=/dev/$VOLGROUP_NAME/vol44 

define the mount point 

MOUNT _POINT=/mnt/vol44 


define NCP server name 
NCP_SERVER=clus1-vol44-SERVER 
define NCP volume name 
NCP_VOLUME=VOL44 


activate the volume group 
exit_on_error vgchange -a ey S$VOLGROUP_NAME 


create the mount point if it does not exist on the node 
ignore error mkdir -p SMOUNT_POINT 
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mount the file system 
exit_on error mount_fs S$MOUNT_DEV SMOUNT_POINT SMOUNT_FS 


mount the NCP volume 
exit_on_error ncpcon mount $NCP_VOLUME=251,PATH=SMOUNT_POINT 


add the IP address 
exit_on_error add_secondary_ipaddress $RESOURCE_IP 


bind the NCP virtual server to the resource IP address 
exit_on_error ncpcon bind --ncpservername=$NCP_SERVER --ipaddress=$RESOURCE_IP 


exit 0 


Sample LVM Resource Unload Scripts Created by NSS Management 
Tools 


Compare the unload scripts in this section to identify the lines that are added when you enable the 
LVM logical volume for NCP file access: 


+ “Without NCP File Access” on page 351 
+ “With NCP File Access” on page 351 


Without NCP File Access 


!/bin/bash 
/opt /novell/ncs/lib/ncsfuncs 


define the IP address 

RESOURCE _IP=10.10.10.44 

define the file system type 

MOUNT_FS=ext3 

define the volume group name (nssmu uses volume name for group name) 
VOLGROUP_NAME=vol44 

define the device 

MOUNT_DEV=/dev/$VOLGROUP_NAME/vol44 

define the mount point 

MOUNT _POINT=/mnt/vol44 


del the IP address 
ignore_error del_secondary_ipaddress $RESOURCE_IP 


unmount the volume 
sleep 10 # if not using SMS for backup, please comment out this line 
exit_on error umount_fs S$MOUNT_DEV S$MOUNT_POINT S$MOUNT_FS 


deactivate the volume group 
exit_on_error vgchange -a n $VOLGROUP_NAME 


exit 0 


With NCP File Access 


!/bin/bash 
/opt/novell/ncs/lib/nesfuncs 


define the IP address 

RESOURCE _IP=10.10.10.44 

define the file system type 

MOUNT_FS=ext3 

define the volume group name (nssmu uses volume name for group name) 
VOLGROUP_NAME=vol44 

define the device 

MOUNT_DEV=/dev/$VOLGROUP_NAME/vol144 

define the mount point 

MOUNT_POINT=/mnt/vol44 


define NCP server name 
NCP_SERVER=clus1-vol44-SERVER 
define NCP volume name 
NCP_VOLUME=VOL44 


unbind the NCP virtual server from the resource IP address 
ignore _error ncpcon unbind --ncpservername=$NCP_SERVER --ipaddress=SRESOURCE_IP 
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del the IP address 
ignore_error del_secondary_ipaddress $RESOURCE_IP 


dismount the NCP volume 
ignore_error ncpcon dismount $NCP_VOLUME 


unmount the volume 
sleep 10 # if not using SMS for backup, please comment out this line 
exit_on_error umount_fs S$MOUNT_DEV $MOUNT_POINT S$MOUNT_FS 


deactivate the volume group 
exit_on_error vgchange -a n $VOLGROUP_NAME 


exit 0 


Sample LVM Resource Monitor Scripts Created by NSS Management 
Tools 


Compare the monitor scripts in this section to identify the lines that are added when you enable the 
LVM logical volume for NCP file access. To use the script, you must also enable monitoring for the 
resource. See Section 10.7, “Enabling Monitoring and Configuring the Monitor Script,” on page 208. 


+ “Without NCP File Access” on page 352 
+ “With NCP File Access” on page 352 


Without NCP File Access 


!/bin/bash 
/opt/novell/ncs/lib/ncsfuncs 


define the IP address 

RESOURCE _IP=10.10.10.44 

define the file system type 
MOUNT_FS=ext3 

define the volume group name 
VOLGROUP_NAME=vol44 

define the device 
MOUNT_DEV=/dev/$VOLGROUP_NAME/vol44 
define the mount point 

MOUNT _POINT=/mnt/vol44 


check the logical volume 
exit_on_error status_lv SMOUNT_DEV 


test the file system 
exit_on_error status_fs $MOUNT_DEV SMOUNT_POINT $MOUNT_FS 


status the IP address 
exit_on_error status_secondary_ipaddress $RESOURCE_IP 


exit 0 


With NCP File Access 


!/bin/bash 
/opt/novell/ncs/lib/nesfuncs 


define the IP address 

RESOURCE _IP=10.10.10.44 

define the file system type 
MOUNT_FS=ext3 

define the volume group name 
VOLGROUP_NAME=vol44 

define the device 

MOUNT _DEV=/dev/$VOLGROUP_NAME/vol44 
define the mount point 

MOUNT _POINT=/mnt/vol44 


define NCP server name 
NCP_SERVER=clus1-vol44-SERVER 
define NCP volume name 
NCP_VOLUME=VOL44 
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13.4.1 


check the LVM logical volume 
exit_on_error status_lv SMOUNT_DEV 


check the NCP volume 
exit_on_error ncpcon volume $NCP_VOLUME 


check the file system 
exit_on_error status_fs S$MOUNT_DEV S$MOUNT_POINT SMOUNT_FS 


status the IP address 
exit_on error status_secondary_ipaddress $RESOURCE_IP 


exit 0 


Configuring an LVM Cluster Resource with LVM 
Commands and the Generic File System Template 


This section describes how to use Linux Logical Volume Manager (LVM) commands to create a 
shared LVM volume group. You use the Generic File System template (Generic FS Template) to 
create a volume group cluster resource that cluster-enables the exiting LVM volume group. 


After you create the resource, you can add lines to its load script, unload script, and monitor script to 
customize the resource for other uses. Compare the Generic FS Template to the resource template 
for your product to determine which lines need to be added or modified. 


¢ Section 13.4.1, “Creating a Shared LVM Volume with LVM Commands,” on page 353 


¢ Section 13.4.2, “Creating a Generic File System Cluster Resource for an LVM Volume Group,” 
on page 358 


¢ Section 13.4.3, “Sample Generic LVM Resource Scripts,” on page 364 


Creating a Shared LVM Volume with LVM Commands 


You can create a shared LVM volume group and logical volume by using native Linux LVM 
commands. 


¢ “Sample Values for the LVM Volume Group and Logical Volume” on page 353 
+ “Creating a Shared LVM Volume Group (Quick Reference)” on page 354 
+ “Creating a Shared LVM Volume Group (Detailed Instructions)” on page 355 


Sample Values for the LVM Volume Group and Logical Volume 

The procedures in this section uses the following sample parameters. Ensure that you replace the 
sample values with your values. 

Parameter Sample Value 


LVM physical volume /dev/sdd 


For clustering, we recommend only one device in the 
LVM volume group. 


LVM volume group name clustervg01 


LVM logical volume clustervol01 
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Parameter Sample Value 


File system type ext3 


This is the file system type that you make on the LVM 
logical volume, such as btrfs, ext2, ext3, reiserfs, 
or xfs. 


For information about mkfs command options for each 
file system type, see the mkfs (8) man page. 


Logical volume path 


/dev/clustervg01/clustervol01 


Mount point for the logical volume 


/mnt/clustervol01 


Creating a Shared LVM Volume Group (Quick Reference) 


You can create the volume group and logical volume by issuing the following LVM commands as the 


root user on the cluster node. 


Before you begin, initialize the SAN device as described in Section 13.2, “Initializing a SAN Device,” 


on page 330. 


When you are done, continue with Section 13.4.2, “Creating a Generic File System Cluster Resource 


for an LVM Volume Group,” on page 358. 


Action 


1. Create the LVM physical volume. 


Command 


pvcreate <device> 


2. Create the clustered LVM volume 
group. 


vgcreate -c y <vg_name> <device> 


3. Activate the volume group 
exclusively on the node. 


vgchange -a ey <vg_name> 


4. Create the LVM logical volume. 


lvcreate -n <lv_name> -L size <vg_name> 


5. Add a file system to the LVM logical 
volume. 


mkfs -t <fs_type> /dev/<vg_name>/<lv_name> [fs_options] 


6. If it does not exist, create the mount 
point path. 


mkdir -p <full_mount_point_path> 


7. Mount the LVM logical volume. 


mount -t <fs_type> /dev/<vg_name>/<lv_name> <mount_point> 


8. Dismount the LVM logical volume 
and deactivate the volume group. 


After you create the Generic LVM 
cluster resource, use the cluster 
resource to control when the volume is 
online or offline. 


354 


umount /dev/<vg_name>/<1lv_name> 


vgchange -a n <vg_name> 
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Creating a Shared LVM Volume Group (Detailed Instructions) 


For detailed instructions, use the following procedure to create the LVM volume group and logical 
volume: 


1 Log in as the Linux root user to the first node of the cluster, then open a terminal console. 
2 Initialize the SAN device as described in Section 13.2, “Initializing a SAN Device,” on page 330. 
LVM allows only one device per volume group. 


3 Create an LVM physical volume on the device (Such as /dev/sdd) by entering: 
pvcreate <device> 


For example: 


pvcreate /dev/sdd 
No physical volume label read from /dev/sdd 
Physical volume "/dev/sdd" successfully created 


4 Display information about the physical volume by entering: 
pvdisplay [device] 


For example, to view information about /dev/sdd: 


pvdisplay /dev/sdd 
"/dev/sdd" is a new physical volume of "512 MB" 
--- NEW Physical volume --- 


PV Name /dev/sdd 

VG Name 

PV Size 512 MB 

Allocatable NO 

PE Size (KByte) 0 

Total PE 0 

Free PE 0 

Allocated PE 0 

PV UUID dg5WG9 - IJvq-MkEM- iRrC-hMKv- Zmwq-YYON3m 


5 Create an LVM volume group (such as clustervg01) on the physical volume by entering: 
vgcreate -c y <vg name> <device> 


For example: 


vgcreate -c y "clustervg01" /dev/sdd 
Clustered volume group "clustervg01" successfully created 


The volume group is automatically activated. 


6 Activate the volume group exclusively on the current server by entering: 
vgchange -a ey <vg name> 


The -a option activates the volume. The ey parameter specifies the values exclusively and 
yes. 


For example: 


vgchange -a ey clustervg01 
logical volume(s) in volume group "clustervg01" now active 


7 View information about the volume group by using the vgdisplay command. 


vgdisplay <vg_name> 
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Notice that 4 MB of the device is used for the volume group’s Physical Extent (PE) table. You 
must consider this reduction in available space on the volume group when you specify the size of 
the LVM logical volume in the next step (Step 8). 


For example: 


vgdisplay clustervg01 
--- Volume group --- 


VG Name clustervg01 
System ID 

Format lvm2 

Metadata Areas 1 

Metadata Sequence No 1 

VG Access read/write 

VG Status resizable 

MAX LV 0 

Cur LV 0 

Open LV 0 

Max PV 0 

Cur PV 1 

Act PV 1. 

VG Size 508.00 MB 

PE Size 4.00 MB 

Total PE 127 

Alloc PE / Size 0/0 

Free PE / Size 127 / 508.00 MB 
VG UUID rqyAd3 -U2dg-HYLw- 0SyN-1007-4BH3-qHvySe 


8 Create an LVM logical volume (Such as clustervol01) on the volume group by entering: 
lvcreate -n <lv_name> -L size <vg_ name> 


Specify the logical volume name, size, and the name of the volume group where you want to 
create it. The size is specified in megabytes by default. 


The logical volume full path name is /dev/<vg_name>/<1v_name>. 


For example: 


lvcreate -n "clustervol01" -L 500 "clustervg01" 
Logical volume "clustervol01" created 


This volume’s full path name is /dev/clustervg01/clustervol0l. 


9 View information about the logical volume by entering: 
lvdisplay -v /dev/<vg_name>/<1v_name> 


For example: 


lvdisplay -v /dev/clustervg01/clustervol01 
Using logical volume(s) on command line 
--- Logical volume --- 


LV Name /dev/clustervg01/clustervol01 
VG Name clustervg01 
LV UUID nIfsMp-alRR-i4Lw-Wwdt-v5io-2hDN-qrWTLH 
LV Write Access read/write 
LV Status available 
open 0 
LV Size 500.00 MB 
Current LE 125 
Segments 1 
Allocation inherit 
Read ahead sectors auto 
- currently set to 1024 
Block device 253:1 


10 Create a file system (such as Btrfs, Ext2, Ext3, ReiserFS, or XFS) on the LVM logical volume by 
entering: 


mkfs -t <fs_type> /dev/<vg_name>/<lv_name> [fs_options] 


For example: 
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13 


14 


mkfs -t ext3 /dev/clustervg01/clustervol0l 
mke2fs 1.41.9 (22-Aug-2009) 
Filesystem label= 
OS type: Linux 
Block size=1024 (log=0) 
Fragment size=1024 (log=0) 
128016 inodes, 512000 blocks 
25600 blocks (5.00%) reserved for the super user 
First data block=1 
Maximum filesystem blocks=67633152 
63 block groups 
8192 blocks per group, 8192 fragments per group 
2032 inodes per group 
Superblock backups stored on blocks: 
8193, 24577, 40961, 57345, 73729, 204801, 221185, 401409 


Writing inode tables: done 
Creating journal (8192 blocks): done 
Writing superblocks and filesystem accounting information: done 


This filesystem will be automatically checked every 29 mounts or 
180 days, whichever comes first. Use tune2fs -c or -i to override. 


If the mount point does not exist, create the full directory path for the mount point. 
mkdir -p <full_mount_point_path> 

For example: 

mkdir -p /mnt/clustervol0l 

Mount the logical volume on the desired mount point by entering: 

mount -t <fs_type> /dev/<vg_name>/<lv_name> <mount_point> 

For example: 

mount -t ext3 /dev/clustervg01/clustervol01 /mnt/clustervol01l 
Dismount the volume and deactivate the LVM volume group by entering: 


umount /dev/<vg _name>/<1lv_name> 
vgchange -a n "vg name" 


This allows you to use the load script and unload script to control when the volume group is 
activated or deactivated in the cluster. 


For example, to unmount the volume and deactivate the clustervg01 volume group, enter 


umount /dev/clustervg01/clustervol01 
vgchange -a n "clustervg01" 
0 logical volume(s) in volume group "clustervg01" now active 


Continue with Section 13.4.2, “Creating a Generic File System Cluster Resource for an LVM 
Volume Group,” on page 358. 
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13.4.2 Creating a Generic File System Cluster Resource for an 
LVM Volume Group 


You can use the Novell Cluster Services Generic File System template (Generic FS Template) to 
create a cluster resource for the LVM volume group. 
1 Ensure that the SAN device is attached to all of the nodes in the cluster. 


2 Ensure that the existing LVM volume you want to cluster-enable is deactive on all nodes in the 
cluster. 


See Step 13 in Section 13.4.1, “Creating a Shared LVM Volume with LVM Commands,” on 
page 353. 


In iManager, select Clusters > My Clusters. 

Select the cluster you want to manage, then click Cluster Options. 
Click the New link. 

Click the Resource radio button, then click Next. 


oun Ff O 


New Resource 
Resource Type Select the type of cluster resource to create. 


p Pool 
© Ææ Resource 


^a Template 


7 Specify information to define your new cluster resource: 
7a Specify the name of the resource you want to create, such as clustervg01. 


Do not use periods in cluster resource names. Novell clients interpret periods as delimiters. 
If you use a space in a cluster resource name, that space is converted to an underscore. 


7b In the Inherit From Template field, browse to select the Generic_FS_Template. 


New Resource 
Cluster Resource Information Create a new cluster resource or cluster resource template. 


Cluster Resource Name: | clustervg01_server 


p r+ 
Inherit From Template Generic_FS_Template.clus, |Q} 


L Online Resource after Create 


\ Define Additional Properties 


7c Deselect or select Online Resource after Create. 


This option is deselected by default. Deselect this option to allow an opportunity to verify the 
scripts and resource policies before you bring the resource online for the first time. 


Select this option to automatically online the resource on its most preferred node as soon as 
it is created and configured. The most preferred node is the first server in the assigned 
nodes list for the resource. You should also select the Define Additional Properties check 
box to configure the resource now. 


7d Select the Define Additional Properties check box. 


When this option is enabled, a wizard walks you through the load, unload, and monitor 
scripts, then allows you to set up the policies and preferred nodes for the cluster resource. 
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7e Click Next. 


If you selected Define Additional Properties, continue with the setup. Otherwise, select the 
resource in the Cluster Objects list to open its properties page, and configure the resource. 


8 Configure the load script for the resource by replacing the variables with your own values, 
specify the Load Script Timeout value, then click Next. 


The following is the default Generic_FS template load script. The variable values must be 
specified before you can successfully bring the resource online. Be mindful that Linux path 
names are case sensitive. The mount path must already exist. You can add a mkdir command in 
the script for the mount point, or create the directory manually on each node before you allow the 
resource to fail over to other nodes. A sample script is available in “Sample Generic LVM 
Resource Load Script” on page 365. 


#!/bin/bash 
/opt/novell/nes/lib/nesfuncs 


# define the IP address 

RESOURCE IP=a.b.c.d 

# define the file system type 

MOUNT _FS=ext3 

#define the volume group name 
VOLGROUP_NAME=name 

# define the device 
MOUNT_DEV=/dev/$VOLGROUP_NAME/volume_name 
# define the mount point 
MOUNT_POINT=/mnt/mount_point 


#activate the volume group 
exit_on_error vgchange -a ey SVOLGROUP_ NAME 


# create the mount point on the node if it does not exist 
ignore_error mkdir -p SMOUNT_POINT 


# mount the file system 
exit_on_error mount_fs SMOUNT_DEV SMOUNT_POINT SMOUNT_FS 


# add the IP address 
exit_on_error add_secondary_ipaddress SRESOURCE_IP 


exit 0 
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9 Configure the unload script for the resource by replacing the variables with your own values, 
specify the Unload Script Timeout value, then click Next. 


The following is the default Generic_FS template unload script. The variable values must be 
specified before you bring the resource online. Be mindful that Linux path names are case 
sensitive. A sample script is available in “Sample Generic LVM Resource Unload Script” on 
page 366. 


#!/bin/bash 
/opt/novell/nces/lib/nesfuncs 


# define the IP address 

RESOURCE _IP=a.b.c.d 

# define the file system type 

MOUNT _FS=ext3 

#define the volume group name 
VOLGROUP_NAME=name 

# define the device 
MOUNT_DEV=/dev/$VOLGROUP_NAME/volume_name 
# define the mount point 
MOUNT_POINT=/mnt/mount_point 


# del the IP address 
ignore_error del _secondary_ipaddress $SRESOURCE_IP 


# unmount the volume 
sleep 10 # if not using SMS for backup, please comment out this line 


exit_on_error umount_fs SMOUNT_DEV SMOUNT_POINT SMOUNT_FS 


#deactivate the volume group 
exit_on_error vgchange -a n SVOLGROUP_ NAME 


# return status 


exit 0 


10 Configure the monitor script for the resource by replacing the variables with your own values, 
specify the Monitor Script Timeout value, then click Next. 


360 OES 11 SP3: Novell Cluster Services for Linux Administration Guide 


The following is the default Generic_FS template monitor script. Be mindful that Linux path 
names are case sensitive. The variable values must be specified before you bring the resource 
online. A sample script is available in “Sample Generic LVM Resource Monitor Script” on 

page 367. 


#!/bin/bash 
/opt/novell/nces/lib/nesfuncs 


# define the IP address 

RESOURCE IP=a.b.c.d 

# define the file system type 

MOUNT _FS=ext3 

#define the volume group name 
VOLGROUP_NAME=name 

# define the device 
MOUNT_DEV=/dev/$VOLGROUP_NAME/volume_name 
# define the mount point 
MOUNT_POINT=/mnt/mount_point 


#check the logical volume 
exit_on_error status_lv SMOUNT_DEV 


# test the file system 
exit_on_error status_fs SMOUNT_DEV SMOUNT_POINT SMOUNT_FS 


# status the IP address 
exit_on_error status_secondary_ipaddress SRESOURCE_IP 


exit 0 


On the Resource Policies page, view and modify the resource’s Policy settings: 


11a (Optional) Select the Resource Follows Master check box if you want to ensure that the 
resource runs only on the master node in the cluster. 


If the master node in the cluster fails, the resource fails over to the node that becomes the 
master. 


11b (Optional) Select the Ignore Quorum check box if you don’t want the cluster-wide timeout 
period and node number limit enforced. 


The quorum default values were set when you installed Novell Cluster Services. You can 
change the quorum default values by accessing the properties page for the Cluster object. 


Selecting this box ensures that the resource is launched immediately on any server in the 
Preferred Nodes list as soon as any server in the list is brought online. 


11c (Optional) By default, the Generic File System resource template sets the Start mode and 
Failover mode to Auto and the Failback Mode to Disable. You can change the default 
settings as needed. 


¢ Start Mode: If the Start mode is set to Auto, the resource automatically loads ona 
designated server when the cluster is first brought up. If the Start mode is set to 
Manual, you can manually start the resource on a specific server when you want, 
instead of having it automatically start when servers in the cluster are brought up. 


+ Failover Mode: If the Failover mode is set to Auto, the resource automatically moves 
to the next server in the Preferred Nodes list if there is a hardware or software failure. If 
the Failover mode is set to Manual, you can intervene after a failure occurs and before 
the resource is started on another node. 


Configuring and Managing Cluster Resources for Shared LVM Volume Groups 361 


¢ Failback Mode: If the Failback mode is set to Disable, the resource continues running 
on the node it has failed to. If the Failback mode is set to Auto, the resource 
automatically moves back to its preferred node when the preferred node is brought 
back online. Set the Failback mode to Manual to prevent the resource from moving 
back to its preferred node when that node is brought back online, until you are ready to 
allow it to happen. 
11d Click Next. 


12 On the Preferred Nodes page, assign preferred nodes for the resource by moving them from the 


Unassigned list to the Assigned list. 


When you bring a resource online, it is automatically loaded on the most preferred node in the 
list. If the node is not available, the other nodes are tried in the order that they appear in the list. 


You can modify the order of the nodes by clicking the Edit (pen) icon to open the list a text editor. 
In the editor, click OK to close the editor. 


My Clusters > clus! .ncs.novell > vold4_resource 


# vol44_resource 


Policies \ Monitoring P yE gee)" 5) Scripts \ Protocols \ Business Continuity 


View or change the preferred nodes for this cluster resource. 


Assigned: Unassigned: 
avalon dorset 
newcastle fairfax 
london brighton 

merrifield 
LPI 
4 
A w 
OK | Cancel | Apply | 


13 Click Finish. 


Typically, the resource creation takes less than 10 seconds. However, if you have a large tree or 
if the server does not hold an eDirectory replica, the create time can take up to 3 minutes. 
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14 


15 


16 


Verify that the resource was created by viewing its entry in the Cluster Objects list on the Cluster 


Options page. 


My Clusters > clus1 nes. 


 clus1.ncs.novell z] 


View cluster resource configuration information and administer cluster resources for the selected cluster 


Cluster Manager \ BCC Manager \ Cluster Event Log J Cluster Options \ Options 
Properties... 


Cluster Objects 
New | Delete | Details 14 Item(s) 


C Type [=| Name IP Address Distinguished Name Pool Name 


Master_|IP_Address Resource 10.10.10.134 — cn=clus1.ou=ncs.o=novell 


avalon 10.10.10.37 — cn=avalon,cn=clus1.ou=nes,o=novell 


clustervg01_ resource 


Av_Template 
DHCP_Template 
DNS_Template 
Generic_FS_Template 
Generic_IP_Service 


)/0/0/0/0 


iFolder_Template 
iPrint Template 


> ae) we] | | | |] T 


(Optional) Enable and configure resource monitoring: 


Resource monitoring is disabled by default. Enable the monitoring function and modify the 
settings for the resource. For detailed information, see Section 10.7, “Enabling Monitoring and 
Configuring the Monitor Script,” on page 208. 


15a In iManager on the Cluster Manager page or Cluster Options page, select the resource 


name link to open its Properties dialog box, then select the Monitoring tab. 


15b Select the Enable Resource Monitoring check box to enable resource monitoring for the 
selected resource. 

15c Specify the Polling Interval to control how often you want the resource monitor script for this 
resource to run. 
You can specify the value in minutes or seconds. See “Polling Interval” on page 209. 

15d Specify the number of failures (Maximum Local Failures) for the specified amount of time 
(Time Interval). 
See “Failure Rate” on page 209. 

15e Specify the Failover Action by indicating whether you want the resource to be set toa 


comatose state, to migrate to another server, or to reboot the hosting node (without 
synchronizing or unmounting the disks) if a failure action initiates. The reboot option is 
normally used only for a mission-critical cluster resource that must remain available. 


See “Failure Action” on page 209. 


Bring the resource online: 


16a 
16b 


Select Clusters > My Clusters. 


On the Cluster Manager page, select the check box next to the new CSM cluster resource, 
then click Online. 


Ensure that the resource successfully enters the Running state. If the resource goes 
comatose instead, it is probably because you made an error when typing values in the script 
definitions. Typical issues are that the target LVM volume is still active locally on a node, the 
path names were not entered as case sensitive, the IP address is not unique in the network, 
or the mount path does not exist. 
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Take the resource offline, go to the resource’s Properties > Scripts page to review and 
modify its scripts as needed to correct errors, then try again to online the resource. 


My Clusters > clust .ncs.nove 


cs.novell [?] 


and resources in the cluster, You can also migrate cluster resources to different servers in the cluster, or change the state 


J cluster Manager \ OOO TTS) BCC Manager \ Cluster Event Log \ Cluster Options 
—Run Report _| 
Epoch: 0 
avalon 


Cluster State 


Online | Offline | Migrate | RespondtoAlert | Refresh» 2 Item(s) 
oO Type | Name State Location Lives Up Since 
@ Master IP_Address Resource @ Running avalon 1 Aug 8, 2012 10:01:33 AM 
| O &@ vol44 resource @ Running avalon 1 
Close 


13.4.3 Sample Generic LVM Resource Scripts 


This section contains sample scripts for the Generic LVM resource. 


The sample scripts in this section use the following sample parameters. Ensure that you replace the 
sample values with your values. 


Parameter Sample Value 
RESOURCE_IP 10.10.10.136 
MOUNT_FS ext3 
VOLGROUP_NAME clustervg01 
MOUNT_DEV 


/dev/S$VOLGROUP_NAME/clustervol01 


MOUNT_POINT /mnt/clustervol01 


+ “Sample Generic LVM Resource Load Script” on page 365 
+ “Sample Generic LVM Resource Unload Script” on page 366 
¢ “Sample Generic LVM Resource Monitor Script” on page 367 
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Sample Generic LVM Resource Load Script 


Use the following sample load script to complete the fields for your LVM volume group cluster 
resource: 


#!/bin/bash 
/opt/novell/ncs/lib/nesfuncs 


# define the IP address 

RESOURCE IP=10.10.10.136 

# define the file system type 

MOUNT _FS=ext3 

# define the volume group name 
VOLGROUP_NAME=clustervg01 

# define the device 

MOUNT _DEV= /dev/ SVOLGROUP_NAME/clustervol01 
# define the mount point 
MOUNT _POINT=/mnt/clustervol01 


# activate the volume group 
exit_on_error vgchange -a ey $VOLGROUP_NAME 


# create the mount point on the node if it does not exist 
ignore_error mkdir -p $MOUNT_POINT 


# mount the file system 
exit_on_error mount_fs SMOUNT_DEV SMOUNT_POINT SMOUNT_FS 


# add the IP address 
exit_on_error add_secondary ipaddress $RESOURCE_IP 


exit 0 
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Sample Generic LVM Resource Unload Script 


Use the following sample unload script to complete the fields for your LVM volume group cluster 
resource: 


#!/bin/bash 
/opt/novell/ncs/lib/nesfuncs 


# define the IP address 

RESOURCE IP=10.10.10.136 

# define the file system type 

MOUNT _FS=ext3 

# define the volume group name 
VOLGROUP_NAME=clustervg01 

# define the device 

MOUNT _DEV= /dev/ SVOLGROUP_NAME/clustervol01 
# define the mount point 

MOUNT _POINT=/mnt/clustervol01 


# del the IP address 
ignore_error del_secondary_ipaddress $SRESOURCE_IP 


# unmount the volume 
sleep 10 # if not using SMS for backup, please comment out this line 
exit_on_error umount_fs $MOUNT_DEV $MOUNT_ POINT $MOUNT_FS 


# deactivate the volume group 
exit_on_error vgchange -a n $VOLGROUP_ NAME 


exit 0 
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13.5 


Sample Generic LVM Resource Monitor Script 


Use the following sample monitor script to complete the fields for your LVM volume group cluster 
resource. To use the script, you must also enable monitoring for the resource. See Section 10.7, 
“Enabling Monitoring and Configuring the Monitor Script,” on page 208. 


#!/bin/bash 
. /opt/novell/ncs/lib/nesfuncs 


# define the IP address 

RESOURCE IP=10.10.10.136 

# define the file system type 

MOUNT _FS=ext3 

# define the volume group name 
VOLGROUP_NAME=clustervg01 

# define the device 

MOUNT _DEV= /dev/ SVOLGROUP_NAME /clustervol01 
# define the mount point 
MOUNT_POINT=/mnt/clustervol01 


# check the logical volume 
exit_on_error status_lv S$MOUNT_DEV 


# test the file system 
exit_on_error status fs SMOUNT_DEV SMOUNT_POINT SMOUNT_FS 


# status the IP address 
exit_on_error status_secondary ipaddress $RESOURCE_ IP 


exit 0 


Creating a Virtual Server Object for an LVM 
Volume Group Cluster Resource 


You can create an NCP virtual server for an existing clustered LVM volume group cluster resource by 
using the /opt /novell/ncs/bin/ncs_ncpserv.py script to create an NCS:NCP Server object. 
Having a virtual server object allows the resource to be viewed in the Browse panel in Novell 
iManager. You can also bind the virtual server name to the IP address to allow users to access the 
resource via an assigned name in addition to its IP address. 


The NCS:NCP Server object does not give users NCP file access to the data on the Linux LVM logical 
volume. You can add commands to the load script to create an NCP volume on the Linux file system 
for NCP users. See “NCP Enabling a clustered LVM volume”. 


The virtual server name is stored in eDirectory in an NCS:NCP Server object under the Cluster object 
where you created the resource. You must add a line to the load and unload scripts that identifies the 
name of this virtual server and a line that binds or unbinds the name to the IP address of the Linux 
POSIX cluster resource. 

¢ Section 13.5.1, “Creating an NCP Virtual Server for the LVM Resource,” on page 368 

¢ Section 13.5.2, “Adding NCP Virtual Server Commands to the Resource Scripts,” on page 368 


¢ Section 13.5.3, “Sample LVM Resource Scripts with an NCP Virtual Server,” on page 370 
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13.5.1 


13.5.2 


Creating an NCP Virtual Server for the LVM Resource 


You use the /opt/novell/nes/bin/nes_ncpserv.py script to create a virtual server object 
(NCS:NCP Server) in eDirectory for the LVM volume group cluster resource. If the resource does not 
have NCP volumes on it, you do not use the -v option. For information about the ncs_ncpser.py 
script, see Section A.9, “ncs_ncpserv.py Script (Creating an NCP Virtual Server Object for a 
Clustered LVM Volume Group),” on page 472. 


1 On the master cluster node, open a terminal console, then log in as the root user. 
2 Inthe console, use the cd command to go to the /opt /novell/ncs/bin directory. 


3 At the command prompt, enter 


./nes_nepserv.py -c vg name -i resource ip address 


Replace the vg_name and resource_ip_address with the information for your particular solution. 


Do not use periods in cluster resource names. Novell clients interpret periods as delimiters. If 
you use a space in a cluster resource name, that space is converted to an underscore. 


For example, to create the NCS:NCP Server object for the clustervg01 cluster resource where 
the IP address is 10.10.10.44 and the cluster context is ou=clusters, ou=city, o=mycompany, 
enter 


./nes_nepserv.py -c clustervg01 -i 10.10.10.44 
The confirmation message is displayed: 


NCP Server 'cn=clusterl-clustervg01-server, ou=clusters, ou=city,o=mycompany' 
created. 


Continue with Section 13.5.2, “Adding NCP Virtual Server Commands to the Resource Scripts,” 
on page 368. 


Adding NCP Virtual Server Commands to the Resource 
Scripts 


After you have created an NCS:NCP Server object, you must modify the resource’s load, unload, and 
monitor scripts to bind and unbind the NCS:NCP Server object with the resource IP address. 


1 In iManager, select Clusters > My Clusters, then select the cluster. 


2 Click the name link of the LVM volume group cluster resource to open its Cluster Resource 


Properties page, then click the Scripts tab. 


3 Modify the LVM resource’s load script: 


3a On the Scripts tab, click Load Script. 
3b At the end of the definition area, add the following lines to define the virtual NCP server 
name: 


# define NCP server name 
NCP_SERVER=clusterl-clustervg01-server 


Replace the NCP server name with the name for your virtual NCP server. 


3c Under the add_secondary_ipaddress command line, add a line to bind the NCP server 
name to the resource IP address: 


# bind the NCP server name 
exit_on_error ncpcon bind --ncpservername=S$NCP_SERVER --ipaddress=S$RESOURCE_IP 
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3d 


3e 


Verify the order of the commands against the “Sample LVM Resource Load Script with an 
NCP Virtual Server” on page 371. 


Click Apply to save your changes. 


The script changes are not active until the next time the cluster resource is taken offline, and 
then brought online. Do not active the script changes at this time. 


4 Modify the LVM resource’s unload script: 


4a 
4b 


4c 


4d 


4e 


On the Scripts tab, click Unload Script. 
At the end of the definition area, add the following lines to define the virtual NCP server 
name: 


# define NCP server name 
NCP_SERVER=clusterl1-clustervg01-server 


Specify the same NCP virtual server name that you used in the load script. 
Under the definition, add a line to unbind the NCP server name from the resource IP 
address: 


# unbind the NCP server name 
ignore_error ncpcon unbind --ncpservername=S$NCP_SERVER --ipaddress=SRESOURCE_IP 


Verify the order of the commands against the “Sample LVM Resource Unload Script with an 
NCP Virtual Server” on page 371. 


Click Apply to save your changes. 


The script changes are not active until the next time the cluster resource is taken offline, and 
then brought online. 


5 Modify the LVM resource’s monitor script: 


5a 
5b 


5c 


5d 


On the Scripts tab, click Monitor Script. 
At the end of the definition area, add the following lines to define the virtual NCP server 
name: 


# define NCP server name 
NCP_SERVER=clusterl-clustervg01-server 


Specify the same NCP virtual server name that you used in the load script. 


Verify the order of the commands against the “Sample LVM Resource Monitor Script with an 
NCP Virtual Server” on page 372. 


Click Apply to save your changes. 


The script changes are not active until the next time the cluster resource is taken offline, and 
then brought online. 


6 At the bottom of the Properties dialog box, click OK to save your changes. 


7 Activate the modified scripts by taking the resource offline and bringing it online. 


7a 
7b 


7c 


Click the Cluster Manager tab. 

Select the check box next to the LVM volume group cluster resource, then click Offline. 
Wait until the resource is reports an Offline status before continuing. 

Select the check box next to the LVM volume group cluster resource, then click Online. 


Wait until the resource is reports an Online status before continuing. 


8 Verify that an NCS:NCP Server object appears in the Browse panel in iManager. 


8a 
8b 


In the iManager toolbar, click the View Objects icon. 


In the left panel, click Browse. 
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8c Browse to the Cluster container to see the virtual server object for the cluster resource, such 
as clusterl-clustervg01-server. 


Tree \ Browse \ Search \ 


Context: | dusters.city.mycompany 


Name: |* 

Type: |_All Available Types 2 
Load Apply Save 
Objects: Multiple Select 

8 (up one level) 
8 
{ E custers dusterveor server | 
E ccusrert poore: server 
£ È asteri (16) 


9 (Optional) To add NCP file access for the Linux volume, continue with Section 13.6, “Enabling 


NCP File Access for a Clustered LVM Volume,” on page 373 


13.5.3 Sample LVM Resource Scripts with an NCP Virtual Server 


This section contains sample scripts for the Generic LVM resource where commands have been 
added to bind and unbind an NCP Virtual Server object with the resource IP address. 


The sample scripts in this section use the following sample parameters. Ensure that you replace the 


sample values with your values. 


Parameter Sample Value 
RESOURCE_IP 10.10.10.136 
MOUNT_FS ext3 
VOLGROUP_NAME clustervg01 


MOUNT_DEV /dev/$VOLGROUP_NAME/clustervol01 
MOUNT_POINT /mnt/clustervol01 
NCP_SERVER clusi-clustervg01-server 


¢ “Sample LVM Resource Load Script with an NCP Virtual Server” on page 371 


¢ “Sample LVM Resource Unload Script with an NCP Virtual Server” on page 371 


¢ “Sample LVM Resource Monitor Script with an NCP Virtual Server” on page 372 
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Sample 


LVM Resource Load Script with an NCP Virtual Server 


Use the following sample load script to complete the fields for your LVM volume group cluster 


resource: 


#!/bin/ba 


# define 
# define 
# define 
# define 


# define 


exit_on_e 
# create 

ignore _er 
exit_on_e 


# add the 
exit_on_e 


exit_on_e 


exit 0 


Sample 


sh 


/opt/novell/ncs/lib/nesfuncs 


the IP address 


RESOURCE IP=10.10.10.136 


the file system type 


MOUNT _FS=ext3 


the volume group name 


VOLGROUP_NAME=clustervg01 


the device 


MOUNT_DEV=/dev/$VOLGROUP_NAME/clustervol01 


the mount point 


MOUNT_POINT=/mnt/clustervol01 


# define NCP server name 
NCP_SERVER=clusterl-clustervg01-server 


# activate the volume group 


rror vgchange -a ey SVOLGROUP_ NAME 


the mount point on the node if it does not exist 
ror mkdir -p SMOUNT_POINT 


# mount the file system 


rror mount_fs $MOUNT_DEV $MOUNT_POINT SMOUNT_FS 


IP address 
rror add_secondary_ipaddress $RESOURCE_IP 


# bind the NCP server name 


rror ncpcon bind --ncpservername=$NCP_ SERVER --ipaddress=SRESOURCE IP 


LVM Resource Unload Script with an NCP Virtual Server 


Use the following sample unload script to complete the fields for your LVM volume group cluster 


resource: 


# define 


# define 


# define 


# define 


# define 


#!/bin/bash 
/opt/novell/ncs/lib/ncsfuncs 


the IP address 


RESOURCE IP=10.10.10.136 


the file system type 


MOUNT _FS=ext3 


the volume group name 


VOLGROUP_NAME=clustervg01 


the device 


MOUNT_DEV=/dev/S$VOLGROUP_NAME/clustervol01 


the mount point 


MOUNT _POINT=/mnt/clustervol01 


# define NCP server name 
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NCP_SERVER=clusterl-clustervg01-server 


# unbind the NCP server name 
ignore error ncpcon unbind --ncpservername=SNCP_ SERVER --ipaddress=SRESOURCE_IP 


# del the IP address 
ignore_error del _ secondary _ipaddress SRESOURCE_IP 


# unmount the volume 
sleep 10 # if not using SMS for backup, please comment out this line 
exit_on_error umount_fs SMOUNT_DEV $MOUNT_POINT $MOUNT_FS 


#deactivate the volume group 
exit _on_error vgchange -a n S$VOLGROUP_ NAME 


exit 0 


Sample LVM Resource Monitor Script with an NCP Virtual Server 


Use the following sample monitor script to complete the fields for your LVM volume group cluster 
resource. To use the script, you must also enable monitoring for the resource. See Section 10.7, 
“Enabling Monitoring and Configuring the Monitor Script,” on page 208. 


#!/bin/bash 
/opt/novell/ncs/lib/nesfuncs 


# define the IP address 

RESOURCE IP=10.10.10.136 

# define the file system type 

MOUNT _FS=ext3 

# define the volume group name 
VOLGROUP_NAME=clustervg01 

# define the device 

MOUNT _DEV= /dev/ SVOLGROUP_NAME /clustervol01 
# define the mount point 
MOUNT_POINT=/mnt/clustervol01 


# define NCP server name 
NCP_SERVER=clusterl-clustervg01-server 


# check the logical volume 
exit_on_error status_lv S$MOUNT_DEV 


# test the file system 
exit_on_error status_fs SMOUNT_DEV $MOUNT_POINT $MOUNT_FS 


# status the IP address 
exit_on_error status_secondary ipaddress $RESOURCE_IP 


# check the status of NCP services 
rendsd status 


if test $? != 0; then 
exit_on_error rendsd restart 
fi 
sleep 5 
exit 0 
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13.6 Enabling NCP File Access for a Clustered LVM 
Volume 


After you create an NCP virtual server object for the clustered LVM volume, you can enable NCP file 
access to a clustered LVM volume by adding NCP commands to the load, unload, and monitor script. 
¢ Section 13.6.1, “Adding NCP Volume Commands to the Resource Scripts,” on page 373 
¢ Section 13.6.2, “Creating a Shared NCP Volume Object,” on page 375 
¢ Section 13.6.3, “Sample LVM Resource Scripts Enabled for NCP File Access,” on page 377 


13.6.1 Adding NCP Volume Commands to the Resource Scripts 


After you have created an NCS:NCP Server object and the Volume object for the NCP volume, you 
can add NCP file access for users by adding NCP volume commands to the resource’s load, unload, 
and monitor scripts. 

1 In iManager, select Clusters > My Clusters, then select the cluster. 


2 Click the name link of the LVM volume group cluster resource to open its Cluster Resource 
Properties page, then click the Scripts tab. 


3 Modify the LVM resource’s load script: 
3a On the Scripts tab, click Load Script. 


3b At the end of the definition area, add the following lines to define the NCP volume name: 


# define NCP volume name 
NCP_VOLUME=CLUSTERVOLO1 


Replace the NCP server name with the name for your virtual NCP server. NCP volume 
names can be up to 14 alphanumeric characters. Supported characters are A to Z, 0 to 9, 
and underscores (_). 


3c After the add_secondary_ipaddress command line, add a line to mount the NCP volume: 


# mount the NCP volume 
exit_on_error ncpcon mount SNCP_VOLUME=251,PATH=SMOUNT_POINT 


3d Verify the order of the commands against the “Sample LVM Resource Load Script with an 
NCP Volume” on page 378. 
3e Click Apply to save your changes. 


The script changes are not active until the next time the cluster resource is taken offline, and 
then brought online. Do not active the script changes at this time. 


4 Modify the LVM resource’s unload script: 
4a On the Scripts tab, click Unload Script. 


4b At the end of the definition area, add the following lines to define the NCP volume name: 


# define NCP volume name 
NCP_VOLUME=CLUSTERVOLO1 


Specify the same volume name that you used in the load script. 


4c Under the ncpcon unbind command, add a line to dismount the NCP volume: 


# dismount the NCP volume 
ignore _error ncpcon dismount $NCP_VOLUME 
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4d Verify the order of the commands against the “Sample LVM Resource Unload Script with an 
NCP Volume” on page 379. 


4e Click Apply to save your changes. 


The script changes are not active until the next time the cluster resource is taken offline, and 
then brought online. 


5 Modify the LVM resource’s monitor script: 
5a On the Scripts tab, click Monitor Script. 
5b At the end of the definition area, add the following lines to define the NCP volume name: 


# define NCP volume name 
NCP_VOLUME=CLUSTERVOLO1 


Specify the same volume name that you used in the load script. 


5c Verify the order of the commands against the “Sample LVM Resource Monitor Script with an 
NCP Volume” on page 380. 


5d Click Apply to save your changes. 


The script changes are not active until the next time the cluster resource is taken offline, and 
then brought online. 


6 At the bottom of the Properties dialog box, click OK to save your changes. 
7 Activate the modified scripts by taking the resource offline and bringing it online. 
7a Click the Cluster Manager tab. 
7b Select the check box next to the LVM volume group cluster resource, then click Offline. 
Wait until the resource is reports an Offline status before continuing. 
7c Select the check box next to the LVM volume group cluster resource, then click Online. 
Wait until the resource is reports an Online status before continuing. 
8 Verify that a clustered NCP Volume object appears in the Browse panel in iManager. 
8a In the iManager toolbar, click the View Objects icon. 
8b In the left panel, click Browse. 
8c Browse to the cluster container to see the NCP volume, such as clus1_CLUSTERVGO1. 


AVALON_TREE. » novell cust C STERVOLOt 
Tree \ Browse \ Search \ | = : even 


+. @ AVALON_TREE F clus1_CLUSTERVOLO1 M 2) 
REY New » | Edit | Delete | Actions » nan 

i nes @) O Name & © 

avalon_LVMVOL_E t. 

e+ avalon_LxVOL_D OA (current level 

= avalon_sYS 

2g ES CLUSTERVOLO? OS \\clus1-clusterva01-server\CLUSTERVOLO1 

G clus1_VOL42 

sA Security (10) 


9 Verify the NCP volume by using the Manage NCP Services plug-in for Novell Remote Manager: 
9a Log in as the root user to Novell Remote Manager. 
9b Select Manage NCP Services, then select Manage Shares. 
9c Locate the NCP volume in the Active Shares list. 


The clustered NCP volume is defined in the LVM volume group cluster resource load script. 
The NCP volume is mounted when you bring the resource online, and dismounted when 
you take the resource offline. You do not use the Mount and Unmount buttons in this 
interface. 
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Œ Diagnose NCP Shares 


® View File System Active Shares 
Œ Manage Linux Share name 
infe (volume name) i 
Manage Hardware 
Use Group Operations ® sys Unmount | 
= Manage NCP Services ey 
View Inventory Reports Ð Lvmvot E Unmount | 
: Ð LxvoL D Unmount 
Manage Serer 
Manage Connections ` 
Manage Connections D ADMIN 
View Logs 
View Statistics 
U mt | 
View Diagnostic Information Ð CLUSTERVOLO1 pmo 
Ð LVMVOL E | Unmount | 
Ð vola Unmount 
Configuration 


| Create new share | 
| Delete existing share | 


| NCP/NSS Bindings | 


9d Click the Information (i) icon to the left of the NCP volume to view details about the NCP 
volume and mount point. 


CLUSTERVOLO1 Share Information 


Description Value 


File system path (mntclustervol0t 
File system shadow path n/a 
Loaded name spaces DOS LONG 


File system type EXT3 

NCP volume ID 253 

Status mounted 
cluster resource 

Sector Size 512 

Sectors per Cluster 8 

Capacity 665.19 MB 


Advanced Information | view | 


| Open File Information | 


Volume tasks 


Available Actions 


| Add Shadow volume | 


Perform Inventory 


| Share Management Home | 


9e Exit Novell Remote Manager. 


Creating a Shared NCP Volume Object 


Use the following procedure to create an NCP volume object on the NCP virtual server you created in 
Section 13.5, “Creating a Virtual Server Object for an LVM Volume Group Cluster Resource,” on 
page 367 

1 Log in to iManager as a cluster administrator. 

2 Select Directory Administration > Create Object. 


3 On the Create Object page, select Volume, then click OK. 
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@ Roles and Tasks 


|[All Categories] z] 


Archive Versioning 
Clusters 
DHCP (OES Linux) 
Directory Administration 

Copy Object 

Create Object 

Delete Object 

Modify Object 

Move Object 

Rename Object 
Distributed File Services 


DNS 


eDirectory Encryption 


@ Create Object 


Select the object class to create 


Available object classes 


Organizational Role [a] 
Organizational Unit 
Person 

Profile 

RBS Module 

Security Container 
Template 

Trusted Root Container 
| User 


C Show all object classes 
Note: This option is only available to authorized users 


OK Cancel 


On the Create Volume page, complete the following information, then click OK. 


Parameter 


Volume name 


Action 


Specify the name that you defined in the load script in the format 
<cluster_name>_<ncp_volumen_name>, such as 
clusterl_CLUSTERVOLO1. 


Host server 


Browse to select the NCP virtual server object for the LVM cluster resource, 
such aS clusterl-clustervg01-server. 


Context 


Browse to select the context where you want to create the Volume object for 
the NCP volume, such as novell. 


Host resource name 


@ Roles and Tasks 
[IAI Categories] = 


Archive Versioning 
Clusters 
DHCP (OES Linux) 
Directory Administration 
Copy Object 
Create Object 
Delete Object 
Modify Object 


Move Object 


Rename Object 


Distributed File Services 


From the drop-down list of available NCP volumes on the server, select the 
NCP volume that you defined in the load script, such as CLUSTERVOLO1. 


Create Volume 
Specify the object name to be created 


Volume name 
| cluster1_CLUSTERVOLO1 | 


Host server 
|cluster1-clustervg01-server \@l 


Context:* 
{novell | 


Host resource name: 
|CLUSTERVOLO1 | 


Is 


OK Cancel 


5 After the Volume object is successfully created, click OK to dismiss the confirmation message. 
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6 Verify that the object is accessible. 
6a In the iManager toolbar, select the View Objects icon. 


6b Browse in the Tree view to locate and view information about the NCP volume’s Volume 
object. 


fs Novell iManager PR Ae®ee?e ? 


AVALON_TREE. p novell > cluste LUSTERVOL [a] 


Tree \ Browse \ Search ) 
? 
EP AVALON TREE F cluster1_CLUSTERVOLO1 FQ 2) 
1B novel 28) New + | Edit | Delete | Actions + 1-1 0f1 
#8 nes (6) | Name Ẹ Q» 
+- avalon_sYS t 
+g cluster1_CLUSTERVOL01 = = 
EP \\cluster1-clustervg01-server O E urent level) 
S = 
een L] © \\cluster1-clusterva01-serveriCLUSTERVOLO1 
FE lost+found 
+ cluster!_VOL_D 
A “Security (10) 


Sample LVM Resource Scripts Enabled for NCP File Access 


This section contains sample scripts for the Generic LVM resource where commands have been 
added to bind and unbind an NCP Virtual Server object with the resource IP address and to mount 
and dismount an NCP volume for the Linux file system. 


The sample scripts in this section use the following sample parameters. Ensure that you replace the 
sample values with your values. 


Parameter Sample Value 

RESOURCE_IP 10.10.10.136 

MOUNT_FS ext3 

VOLGROUP_NAME clustervg01 

MOUNT_DEV /dev/S$VOLGROUP_NAME/clustervol01 
MOUNT_POINT /mnt/clustervol01 

NCP_SERVER clusi-clustervg01-server 
NCP_VOLUME CLUSTERVOLO1 

Volume ID 251 


Ensure that the volume ID that you assign to the NCP 
volume is unique across all nodes in the cluster. 
Clustered NCP volume IDs are assigned from 254 to 
0, in descending order. 


+ “Sample LVM Resource Load Script with an NCP Volume” on page 378 
¢ “Sample LVM Resource Unload Script with an NCP Volume” on page 379 
¢ “Sample LVM Resource Monitor Script with an NCP Volume” on page 380 
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Sample LVM Resource Load Script with an NCP Volume 


Use the following sample load script to complete the fields for your LVM volume group cluster 
resource that has an NCP virtual server and an NCP volume: 


#!/bin/bash 
/opt/novell/ncs/lib/ncsfuncs 


# define the IP address 

RESOURCE IP=10.10.10.136 

# define the file system type 

MOUNT _FS=ext3 

# define the volume group name 
VOLGROUP_NAME=clustervg01 

# define the device 
MOUNT_DEV=/dev/$VOLGROUP_NAME/clustervol01 
# define the mount point 
MOUNT_POINT=/mnt/clustervol01 


# define NCP server name 
NCP_SERVER=clusterl-clustervg01-server 
# define NCP volume name 
NCP_VOLUME=CLUSTERVOLO1 


# activate the volume group 
exit_on_error vgchange -a ey $VOLGROUP_NAME 


# create the mount point on the node if it does not exist 
ignore_error mkdir -p S$MOUNT_POINT 


# mount the file system 
exit_on_error mount_fs SMOUNT_DEV SMOUNT_POINT SMOUNT_FS 


# mount the NCP volume 
exit_on_error ncpcon mount SNCP_VOLUME=251,PATH=SMOUNT_POINT 


# add the IP address 
exit_on_error add_secondary_ipaddress SRESOURCE_IP 


# bind the NCP server name 
exit_on_error ncpcon bind --ncpservername=S$NCP_SERVER --ipaddress=$RESOURCE_IP 


exit 0 
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Sample LVM Resource Unload Script with an NCP Volume 


Use the following sample unload script to complete the fields for your LVM volume group cluster 
resource that has an NCP virtual server and an NCP volume: 


#!/bin/ba 


# define 
# define 
# define 
# define 


# define 


# unbind 
ignore _er 


# del the 
ignore_er 


# dismoun 
ignore_er 


sh 


the 


the 


MOUNT _FS=ext3 


the 


the 


the 


the 
ror 


IP 
ror 


ror 


/opt/novell/ncs/lib/ncsfuncs 


IP address 


RESOURCE IP=10.10.10.136 


file system type 


volume group name 


VOLGROUP_NAME=clustervg01 


device 


MOUNT_DEV=/dev/$VOLGROUP_NAME/clustervol01 


mount point 


MOUNT_POINT=/mnt/clustervol01 


# define NCP server name 
NCP_SERVER=clusterl-clustervg01-server 
# define NCP volume name 
NCP_VOLUME=CLUSTERVOLO1 


NCP server name 


ncpcon unbind --ncpservername=SNCP_ SERVER --ipaddress=SRESOURCE_ IP 
address 
del_ secondary _ipaddress SRESOURCE_IP 


t the NCP volume 


ncpcon dismount $NCP_VOLUME 


# unmount the Linux volume 


sleep 10 # if not using SMS for backup, please comment out this line 
exit_on_error umount_fs SMOUNT_DEV $MOUNT_POINT $MOUNT_FS 


#deactivate the volume group 
exit_on_error vgchange -a n SVOLGROUP_ NAME 


exit 0 
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Sample LVM Resource Monitor Script with an NCP Volume 


Use the following sample monitor script to complete the fields for your LVM volume group cluster 
resource that has an NCP virtual server and an NCP volume. To use the script, you must also enable 
monitoring for the resource. See Section 10.7, “Enabling Monitoring and Configuring the Monitor 
Script,” on page 208. 


#!/bin/bash 
/opt/novell/ncs/lib/nesfuncs 


# define the IP address 

RESOURCE IP=10.10.10.136 

# define the file system type 

MOUNT _FS=ext3 

# define the volume group name 
VOLGROUP_NAME=clustervg01 

# define the device 
MOUNT_DEV=/dev/$VOLGROUP_NAME/clustervol01 
# define the mount point 
MOUNT_POINT=/mnt/clustervol01 


# define NCP server name 
NCP_SERVER=cluster1-clustervg01-server 
# define NCP volume name 
NCP_VOLUME=CLUSTERVOLO1 


# check the logical volume 
exit_on_error status_lv S$MOUNT_DEV 


# test the file system 
exit_on_error status_fs SMOUNT_DEV $MOUNT_POINT $MOUNT_FS 


# status the IP address 
exit_on_error status_secondary_ ipaddress $RESOURCE_IP 


# check the status of NCP services 
rendsd status 


if test $? != 0; then 
exit_on_error rendsd restart 
fi 
sleep 5 
exit 0 


Modifying the LVM Resource Scripts for Other 
Services 


After you create an LVM volume group cluster resource, you can add lines to its load script, unload 
script, and monitor script to customize the resource for other uses. Compare the Generic File System 
template to the resource template for your product to determine which lines need to be added or 
modified. 


The Novell Cluster Services resource templates are available in the Clusters plug-in for iManager. 
From the Cluster Options page, select the resource template to view its properties, then click the 
Scripts tab to access its default load, unload, and monitor scripts. You can also select the check box 
next to the resource template, then click Details to access its properties. See Section 10.3, “Using 
Cluster Resource Templates,” on page 200. 
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13.8 Renaming the Mount Point Path for a Clustered 
LVM Volume 


For a clustered LVM volume, you can rename the mount point path by modifying the mount point 
variable in the cluster load, unload, and monitor scripts. 


Open iManager in a web browser, then log in as an administrator user. 
In Roles and Tasks, select Clusters > My Clusters. 


Select the cluster where you created the volume group cluster resource. 


A WN PF 


On the Cluster Manager page, select the check box next to the resource, then click Offline. 
Wait for the status to report that it is offline, then continue. 


5 Modify the mount point path value in the load, unload, and monitor scripts for the LVM volume 
group Cluster resource: 


5a On the Cluster Manager page, select the resource’s name link to open its Cluster Properties 
page, then click the Scripts tab. 


The Scripts tab automatically displays the load script. 
5b Modify the load script: 
5b1 In the load script, type the new value for the mount point in the MOUNT_POINT 
variable: 
MOUNT_POINT=/usr/novell/ext3/vol44 


5b2 Ensure that a mkdir command is added above the Linux mount command line in the 
load script to create the path on nodes if it does not exist. 


# create the mount point if it does not exist on the node 
ignore_error mkdir -p S$MOUNT_POINT 


You can alternatively make the new path by using the mkdir command in a terminal 
console on each node. If the master node is not the most preferred node, ensure that 
you make the path before you bring the resource online. 


5b3 Click Apply. 

5c Click the Unload Script link, type the new value for the mount point in the MOUNT_POINT 
variable, then click Apply. 
MOUNT _POINT=/usr/novell/ext3/vol44 


5d Click the Monitor Script link, type the new value for the mount point in the MOUNT_POINT 
variable, then click Apply. 


MOUNT_POINT=/usr/novell/ext3/vol44 


5e At the bottom of the page, click OK to close the Properties page and save your changes. 
The changes do not take effect until the resource is brought online. 
6 Bring the resource online to allow the script changes to take effect. 
6a In Roles and Tasks, select Clusters > My Clusters, then select the cluster. 
6b On the Cluster Manager page, select the check box next to the resource, then click Online. 
6c Verify that the resource comes online and reports a Running state. 


If the resource goes into a Comatose state, it is probably because you made a mistake in 
the lines you added or modified in the scripts. Take the resource offline, then go back to 
correct the scripts, and try to bring it online again. 
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7 In NSSMU, verify that the new mount point is used when the clustered LVM volume resource is 
brought online: 


7a Login as the root user to the node that is hosting the resource, then start NSSMU by 
entering: 


nssmu 


7b From the NSSMU main menu, select Linux Volumes, then press Enter. 

7c Inthe Linux Volumes list, select the clustered LVM volume. 

7d View the volume details to verify that the mount point has changed. 
For example, the mount point is /usr/novell/ext3/vol44. 


Linux Volume Information 


ESC=Exit 


Ins=Create Del=Delete F3=Rename F5=Refresh F7=Mount/Dismount 


7e Click Escape twice to exit NSSMU. 


13.9 Renaming a Clustered LVM Logical Volume 


For a clustered LVM logical volume, there is no easy tool for renaming the volume. You can rename 

the LVM logical volume by using the 1vrename command, then modify the volume name in the cluster 
load, unload, and monitor scripts. The command does not change the volume group name. The LVM 
cluster resource must be offline while you rename the logical volume and modify the scripts. 


Using the 1vrename command to rename the LVM logical volume does not modify other related 
settings and objects that are used by the LVM cluster resource. You can optionally also modify the 
following: 
¢ Mount point path 
+ Resource name 
+ If NCP is enabled for the LVM logical volume: 
+ NCP virtual server name 
+ NCP volume name 
+ Volume object for the NCP volume on the virtual server 
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In the following procedure, you take the resource offline, modify the related parameters, modify the 
resource scripts with the new values, then bring the resource online. 
1 Log in to the server as the root user, then open a terminal console. 


2 Bring the LVM cluster resource offline. 
cluster offline <lvm_resource_name> 
For example, to offline the vol44_resource, enter 
cluster offline vol44 resource 


Wait until the resource is offline before continuing. 


3 At the command prompt, enter 
lvrename </dev/vg_ name/old_lv_name> </dev/vg_name/new_lv_name> 


Replace vg_name with the name of the volume group. If you created the LVM logical volume in 
NSSMU, the volume group name is the same as the logical volume name. If you created the 
LVM logical volume with NLVM or with LVM commands, you might have used a different name 
for the volume group. 


Replace old_/v_name with the current name of the LVM logical volume. 
Replace new_/v_name with the new name of the LVM logical volume. 
For example, to change the name of the logical volume on volume group vghome from 
lv_users to lv_home, enter 
lvrename /dev/vghome/lv_users /dev/vghome/1lv_home 
4 Modify the load, unload, and monitor scripts for the LVM cluster resource to use the new LVM 
logical volume name in the value for the MOUNT_DEV parameter. 
4a Open iManager in a web browser, then log in as a cluster administrator user. 


4b In Roles and Tasks, select Clusters > My Clusters, then select the cluster where you 
created the LVM cluster resource. 


4c On the Cluster Manager page, select the check box next to the resource, then click Offline. 
Wait for the status to report that it is offline, then continue. 


4d Modify the MOUNT_DEV value in the load, unload, and monitor scripts for the LVM volume 
group cluster resource: 


4d1 On the Cluster Manager page, select the resource’s name link to open its Cluster 
Properties page, then click the Scripts tab. 


The Scripts tab automatically displays the load script. 

4d2 Modify the load script: 
In the load script, type the new value for the logical volume in the MOUNT_DEV 
variable, then click Apply. 


# define the device 
MOUNT _DEV=/dev/$VOLGROUP_NAME/1v_home 


4d3 Click the Unload Script link, type the new value for the logical volume in the 
MOUNT_DEV variable, then click Apply. 


# define the device 
MOUNT _DEV=/dev/$VOLGROUP_NAME/1v_home 
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4d4 Click the Monitor Script link, type the new value for the logical volume in the 
MOUNT_DEV variable, then click Apply. 


# define the device 
MOUNT _DEV= /dev/ SVOLGROUP_NAME/ lv_home 


4d5 At the bottom of the page, click OK to close the Properties page and save your 
changes. 


The changes do not take effect until the resource is brought online. 


5 (Optional) Rename the mount point path that you use for the logical volume. The mount point 


should still be unmounted when you perform this task. 


For information, see Section 13.8, “Renaming the Mount Point Path for a Clustered LVM 
Volume,” on page 381. 


6 (Optional) Rename the resource. 


Ensure that the resource is offline, then enter 


cluster rename <old_resource name> <new_resource_name> 


7 (Optional) If you created an NCP virtual server for the resource, rename the NCP virtual server 


name. 


Use the Directory Administration > Delete Object task in iManager to delete the old NCP virtual 
server (the NCS:NCP Server object) for the resource, then use /opt /novell/nes/bin/ 

nes _ncpserv.py to create a new virtual server for the resource. For information, see 

Section 13.5.1, “Creating an NCP Virtual Server for the LVM Resource,” on page 368. Ensure 
that you update the load, unload, and monitor scripts. 


8 (Optional) If NCP file access is enabled for the LVM logical volume, rename the NCP volume and 


its Volume object. 


8a Modify the NCP volume name for the NCP_VOLUME parameter in the load, unload, and 
monitor scripts for the LVM cluster resource. For information, see Section 13.5.2, “Adding 
NCP Virtual Server Commands to the Resource Scripts,” on page 368. Bring the resource 
online, but do not allow users to access the volume until the Volume object is re-created. 


8b Use the Directory Administration > Delete Object task in iManager to delete the old Volume 
object, then create a new Volume object that uses the newly created NCP virtual server 
name and new NCP volume name. For information, see Section 13.6.2, “Creating a Shared 
NCP Volume Object,” on page 375. 


9 Bring the resource online. At the command prompt, enter 


cluster online <resource_name> 


Disabling Clustering for an LVM Volume Group 
and Logical Volume 


Before you attempt to disable clustering for an LVM volume group and logical volume, you must take 
the resource offline. 


WARNING: If you attempt to delete a cluster resource without first offlining it, deletion errors occur, 
and the data associated with the clustered volume group might not be recoverable. 
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Deleting a volume group cluster resource disables only the Novell Cluster Services cluster settings. 
There are additional tasks to perform to prepare the LVM volume group and logical volume for non- 
clustered access on one of the cluster nodes. To delete a resource and create a new one with the 
same name, you must wait to create the new one until after eDirectory synchronizes all of the objects 
in the tree related to the deleted resource. 


If the volume was NCP enabled, the definition of the NCP volume in the load script is automatically 
deleted, but you must manually remove its NCP Volume object in eDirectory. To re-create the NCP 
volume on the non-clustered Linux LVM logical volume, can use the Manage NCP Services plug-in 
for Novell Remote Manager or use the ncpcon create volume command. 


All resource configuration should happen from the master node. On the Cluster Options page for 
iManager, you are automatically connected to the Cluster object, which is associated with the master 
node. 


We strongly recommend that when you need to delete a cluster resource, that you do so only from 
the master node in the cluster. You might want to delete a cluster resource on a non-master node if 
the master node is not a preferred node for the resource, or if there is a resource mutual exclusion 
rule that prohibits the resource from being moved there. If the resource cannot be migrated to the 
master node, follow the additional steps that are annotated as “Non-Master’. 


Use the procedure in this section to disable clustering for a Linux LVM volume group and logical 
volume. Afterwards, you can mount and dismount the volume on only one node in the cluster. 


1 Ensure that the resource is online on the node where you want mount the volume after clustering 
is disabled. 


If the resource is not on the desired node, open a terminal console as the root user, then enter 
cluster migrate <resource_name> <from_node> <to_node> 

For example, if node2 is the to node, enter 

cluster migrate vg44 resource nodel node2 


2 Log in to iManager as a cluster administrator. 
3 In Roles and Tasks, select Clusters > My Clusters, then select the cluster. 
4 Take the volume group cluster resource offline, by using one of the following methods: 


+ In iManager on the Cluster Manager page, select the check box next to the LVM volume 
group cluster resource (Such as vg44_resource), then click Offline. Wait until the resource 
is offline to continue. 
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My Clusters > clus1 ncs.novell 


è clus1.ncs.novell 2 
View the status of both servers and resources in the cluster. You can also migrate cluster resources to different servers in the cluster, or change the state 
of resources to offline or online 

J cluster Manager \ JET ETTS"\ BCC Manager \ Cluster Event Log \ Cluster Options 

Run Report 
Epoch: 0 


& 


avalon 


Online | Offline | Migrate | Respond to Alert | Refresh» 2 Item(s) 
CO Type Ẹ| Name State Location Lives Up Since 
Ææ  Master_IP_Address_Resource @ Running avalon 1 Aug 8, 2012 10:01:33 AM 
O @ voda resource =) Offline 1 
Close 


+ Open a terminal console as the root user, then enter 
cluster offline <resource_name> 


The unload script unbinds the NCP virtual server from the resource IP address, dismounts the 
NCP volume, dismounts the Linux LVM logical volume, and deactivates the Linux LVM volume 
group. 


5 Delete the volume group cluster resource: 


5a (Non-Master) If the volume group was taken offline on a non-master node, verify that the 
revision and resource information is the same on the non-master node as on the master 
node before you delete the resource. 


5a1 On the non-master node, log in as the root user, then open a terminal console. At a 
command prompt on the non-master node, enter 
/opt/novell/ncs/bin/nes-configd.py -init 


5a2 Look at the file /var/opt /novell/ncs/resource-priority.conf to verify that it has 
the same information (REVISION and NUMRESOURCES) as the file on the master 
node. 


5b Click the Cluster Options tab. 
5c Select the check box next to the volume group cluster resource, then click Delete. 


My Clusters > clust.ncs.novell 


È clus1.ncs.novell 


View cluster resource configuration inform: 


K 


juster resources for te selected cluster 


Cluster Manager \ BCC Manager \ Cluster Event Log SETTIR 


Properties... | 

Cluster Objects 

New | Delete | Details 15 Item(s) 
O Ime Name IP Address Distinguished Name Pool Name 


Æ Master IP Address Resource 10.10.10.134  cn=clus1 ou=ncs,o=novell 
avalon 10.10.10.37  cn=avalon,cn=clus1 ,ou=ncs,o=novelll 


Ld 
Ææ vada resource 
s 


ogon 


vol42 resource 
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5d When you are prompted to confirm the deletion, click OK to continue, or click Cancel to 
abort the deletion. 


Are you sure you want to delete the selected resource(s)? 


5e (Non-Master) If the volume group was taken offline on a non-master node, verify that the 
revision and resource information is the same on the master node as on the non-master 
node after you delete the resource. 


5e1 


5e2 


5e3 


5e4 
5e5 


5e6 


5e7 


On the master node, log in as the root user, then open a terminal console. At a 
command prompt on the master node, enter 


/opt/novell/ncs/bin/ncs-configd.py -init 


Look at the file /var/opt /novell/ncs/resource-priority.conf to verify that it has 
the same information (REVISION and NUMRESOURCES) as that of the non-master 
node where you deleted the cluster resource. 


In iManager, select Clusters > Cluster Options, then browse to select the Cluster 
object. 


Click Properties, select the Priorities tab, then click Apply on the Priorities page. 


At a command prompt, enter 
cluster view 


The cluster view should be consistent. 


Look at the file /var/opt /novell/ncs/resource-priority.conf on the master node 
to verify that the revision number increased. 


If the revision number increased, you are done. Do not continue with Step 13. 


If the deleted resource is the only one in the cluster, the priority won’t force the update. 
A phantom resource might appear in the interface. You need to restart Cluster Services 
to force the update, which also removes the phantom resource. 


If the revision number did not automatically update in the previous steps, restart Novell 
Cluster Services by entering the following on one node in the cluster: 


cluster restart [seconds] 


For seconds, specify a value of 60 seconds or more. 


For example: 


cluster restart 120 
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6 If the Linux volume was NCP enabled, delete the NCP volume object. 
6a In iManager, select Directory Administration > Delete Object. 
6b On the Delete Object page, browse to locate and select the resource’s NCP Volume object, 
such as clus1_VOL44.novell, then click OK. 


@ Delete Object 
Specify the object(s) to delete 


Select a single object | Select multiple objects | Simple Selection | Advanced Selection 


Object name 
clus1_VOL44_novell 


OK Cancel 


6c Click OK to delete the NCP volume object, then click OK again to close the success 
message. 


7 If the Linux volume was NCP enabled, or if you manually created an NCP virtual server for the 
resource, delete the NCP virtual server object: 


7a In iManager, select Directory Administration > Delete Object. 
7b On the Delete Object page, browse to locate and select the resource’s NCS:NCP Server 
object, such as clus1-vg44-SERVER.ncs.novell, then click OK. 


@ Delete Object 
Specify the object(s) to delete 


Select a single object | Select multiple objects | Simple Selection | Advanced Selection 


Object name 
| clus1-vg44-SERVER.ncs.novell 


OK Cancel 


7c Click OK to delete the NCP virtual server, then click OK again to close the success 
message. 


7d Visually confirm that the resource does not appear in the list of Cluster objects, then exit 
iManager. 


8 Log in as the root user on the server where the resource was online, then open a terminal 
console. 


9 Deactive the volume group from Clustered LVM: 
vgchange -c n <vg name> 
For example: 
vgchange -c n vg44 
10 Activate the volume group locally on the current node: 
vgchange -a ey <vg name> 
For example: 
vgchange -a ey vg44 
11 Mount the LVM logical volume locally on the current node: 
mount -t <fstype> <device_name> <full_mount_point_path> 


Replace fstype with the file system type of the volume. 
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Replace device_name with the full device path of the logical volume, such as /dev/<vg_name>/ 
</v_name>. 


Replace full_mount_point_path with the volume’s mount point. 
For example: 


mount -t ext3 /dev/vg44/vol44 /mnt/vol44 


Add an entry for the LVM volume in the /etc/£stab file to allow the volume to be mounted 
automatically on reboot. It also provides the automatic mount information for NSSMU to use to 
mount and dismount the volume on the node. 


In a text editor, modify the /etc/fstab file to specify the mount point information and file system 
type. 
For example, complete the line for the volume’s device path, such as: 


/dev/vg44/vol44 /mnt/vol44 ext3 rw 00 


“fstab (/etc) - gedit 


File Edit View Search Tools Documents Help 


m E open A save | =) & undo do 


/dev/sda2 swap swap defaults 00 
/dev/sda3 / ext3 acl,user_xattr 3i 
/dev/sdal /boot ext2 acl,user_xattr 12 
proc /proc proc defaults 00 
| sysfs /sys sysfs noauto 00 
debugfs /sys/kernel/debug debugfs noauto 00 
usbfs /proc/bus/usb usbfs noauto 00 
devpts /dev/pts devpts mode=0620, gid=5 00 
/dev/vg44/vol44 /mnt/vol44 ext3 rw oq 


View details about the non-clustered LVM logical volume: 
13a Open an terminal console as the root user, launch NSSMU: 


nssmu 


13b In the NSSMU main menu, select Linux Volumes, then press Enter. 
13c On the Linux Volumes page, then select the volume to view its details. 


The volume is no longer cluster enabled. You can mount and dismount the volume only on 
the current node. 


Volume Information 


Ins=Create Del=Delete F3=Rename F5=Refresh F7=Mount/Dismount 
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13.11 


14 (Optional) Create an NCP volume for the Linux volume by using Novell Remote Manager. For 
information, see “Creating NCP Volumes on Linux File Systems” in the OES 11 SP3: NCP 


Server for Linux Administration Guide. 


To use the same volume name that was used in the cluster resource load script, wait to re-create 
the NCP volume until after eDirectory synchronizes all of the objects in the tree related to the 
deleted resource. 


Deleting a Clustered LVM Volume Group and 
Logical Volume 
Before you delete a clustered LVM volume group, you must take the volume group cluster resource 


offline, and delete the cluster resource object and related objects in eDirectory. 


All resource configuration must happen from the master node. On the Cluster Options page for 
iManager, you are automatically connected to the Cluster object, which is associated with the master 


1 Log in to iManager as a cluster administrator. 
2 In Roles and Tasks, select Clusters > My Clusters, then select the cluster. 
3 Take the volume group cluster resource offline: 
3a On the Cluster Manager page, select the check box next to the volume group cluster 


resource, then click Offline. Wait until the resource is offline to continue. 


My Clusters > clus! ncs.novell 


è clus 


ofr 


J cluster Manager | ET EETS5) BCC Manager | Cluster Event Log | Cluster Options 


Run rt 


ncs.novell 


of bo 


Epoch: 0 


B 


avalon 


Online | Offline | Migrate | Respond to Alert | Refresh» 2 Item(s) 


E Type | Name State Location Lives Up Since 
m 2 Master_IP_Address Resource (@) Running avalon 1 Aug 8, 2012 10:01:33 AM 
o & vol44_resource =) Offline 1 

Close 


The unload script unbinds the NCP virtual server from the resource IP address, dismounts 
the NCP volume, dismounts the Linux LVM logical volume, and deactivates the Linux LVM 
volume group. 


4 Delete the volume group cluster resource: 
4a Click the Cluster Options tab. 
4b Select the check box next to the volume group cluster resource, then click Delete. 


390 OES 11 SP3: Novell Cluster Services for Linux Administration Guide 


My Clusters > clust.ncs.novell 


È clus1.ncs.novell 


View cluster resource configuration information and administer cluster resources for the selected cluster 


2 


Cluster Manager \ BCC Manager \ Cluster Event Log SETITI 


Properties... _| 

New | Delete | Details 15 Item(s) 
O Ime 3) Name IP Address Distinguished Name Pool Name 

O @ Maser IP Address Resource 10.10.10.134 — cn=clust,ou=ncs,o=novell 

O ® aao 10.10.10.37  cn=avalon,cn=clus1 ,ou=ncs,o=novelll 

K @ vada resource 

O @ — vol42 resource 


4c When you are prompted to confirm the deletion, click OK to continue, or click Cancel to 
abort the deletion. 


Are you sure you want to delete the selected resource(s)? 


canes] 


5 If the Linux volume was enabled for NCP file access, delete the NCP volume object. 
5a In iManager, select Directory Administration > Delete Object. 


5b On the Delete Object page, browse to locate and select the resource’s NCP Volume object 
(such as clus1_VOL44.novell), then click OK. 


@ Delete Object 


Specify the object(s) to de! 


ete 


Select a single object | Select multiple objects | Simple Selection | Advanced Selection 


Object name 
clus1_VOL44.novell 


OK Cancel 


5c Click OK to delete the NCP volume object, then click OK again to close the success 
message. 


6 If the Linux volume was NCP enabled, or if you manually created an NCP virtual server for the 
resource, delete the NCP virtual server object. 


6a In iManager, select Directory Administration > Delete Object. 


6b On the Delete Object page, browse to locate and select the resource’s NCS:NCP Server 
object (Such as clus1-vg44-SERVER.ncs.novell), then click OK. 


@ Delete Object 
Specify the object(s) to delete. 


Select a single object | Select multiple objects | Simple Selection | Advanced Selection 


Object name 
| clus1-vg44-SERVER.ncs.novell 


OK Cancel 


6c Click OK to delete the NCP virtual server, then click OK again to close the success 
message. 
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7 Delete the LVM volume group and logical volume: 


7a Login as the root user to the cluster node where the resource was online, then open a 
terminal console. 


7b Ata command prompt, launch NSSMU: 
nssmu 


7c In the NSSMU main menu, select Linux Volumes, then press Enter. 
7d In the Linux Volumes list, select the clustered linux volume, then press Delete. 


7e When you are prompted to confirm the delete action, press y (Yes) to continue, or press n 
(No) to cancel the delete action. 


Deleting the volume and volume group puts the device in an uninitialized state. 
7f Press Esc to return to the main menu. 
8 Re-initialize the device: 
8a In the NSSMU main menu, select Devices, then press Enter. 
8b In the Devices list, select the device. 


“F3=Init FSRefresh Ft 


8c Press F3 to initialize the device. 


8d When you are prompted to confirm the initialization action, read the warning message, then 
press y (Yes) to continue, or press n (No) to cancel the action. 
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8e Select DOS or GPT as the partitioning type, then press Enter. 
8f Visually verify that the device was initialized and the specified partition type is displayed. 
8g Press Esc twice to exit NSSMU. 

9 Verify that the LVM volume group is deleted by entering the following the native LVM command: 


vgdisplay 


13.12 Deleting a Clustered LVM Volume (Created in 
NSSMU or NLVM) 


We strongly recommend that you delete a cluster-enabled LVM volume only from the master node in 
the cluster. This allows the cluster information to be automatically updated. 


The procedures in this section assume that you created the clustered LVM volume in NSSMU or 
NLVM. There are default naming conventions applied by these tools that might not apply to LVM 
volume groups that you created and cluster-enabled by using native LVM tools and the Generic File 
System template. 


WARNING: Deleting an LVM volume destroys all data on it. 


NSSMU and the nlvm delete linux volume <volume_name> command delete the cluster-enabled 
LVM volume as well as the related objects in eDirectory: 


+ Linux LVM volume group and logical volume from the file system 
¢ Cluster Resource object for the LVM resource 
+ Ifthe LVM volume is NCP-enabled: 

+ Volume object for the LVM volume 

¢ Virtual server for the LVM resource (NCS:NCP Server object) 


When the LVM volume resides on the master node, the cluster information is automatically updated. 


When the LVM volume resides on a non-master node, additional steps are required to update the 
cluster information. A cluster restart might be needed to force the information to be updated. 


Use the following procedures to delete a cluster-enabled LVM volume: 


¢ Section 13.12.1, “Deleting a Cluster-Enabled LVM Volume on the Master Node,” on page 393 
¢ Section 13.12.2, “Deleting a Cluster-Enabled LVM Volume on a Non-Master Node,” on page 394 


13.12.1 Deleting a Cluster-Enabled LVM Volume on the Master Node 


1 If the LVM resource is on a non-master node in the cluster, migrate it to the master node. As the 
root user, open a terminal console, then enter 


cluster migrate <resource_ name> <master_node_name> 


To migrate the resource, the master node must be in the resource’s preferred nodes list. 


2 Use the cluster status command to check the resource status. If the resource is online or 
comatose, take it offline. 


As the root user, enter 
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cluster offline <resource_name> 
Use the cluster status command to verify that the resource has a status of Offline before you 
continue. 
3 Delete the LVM volume on the master node by using NSSMU. 
You can alternatively use the nlvm delete linux volume <1x_volume_name> command. 
3a In NSSMU, select Linux Volumes, then press Enter. 
3b Select the unmounted LVM volume, then press Delete. 
3c Select OK to confirm, then press Enter. 
4 Inthe Tree View in iManager, browse the objects to verify that the following objects were deleted: 
+ LVM resource object (from the Cluster container) 
+ If the LVM volume was NCP-enabled: 
+ Volume object for the LVM volume 
¢ Virtual server for the LVM resource (NCS:NCP Server object) 
5 Re-initialize the device that contained the LVM volume. 


When NLVM or NSSMU removes the Linux LVM volume group, it leaves the device in an 
uninitialized state. 


5a In NSSMU, select Devices, then press Enter. 

5b Select the device, then press F3 (Initialize). 

5c Press y (Yes) to confirm. 

5d Select the partitioning scheme as DOS or GPT, then press Enter. 


6 (Optional) Use a third-party SAN management tool to assign the device to only one desired 
server. 


13.12.2 Deleting a Cluster-Enabled LVM Volume on a Non-Master 
Node 


1 Log in as the root user to the non-master node where the cluster resource currently resides, 
then open a terminal console. 


2 Use the cluster status command to check the resource status. If the resource is online or 
comatose, take it offline by using one of the following methods: 


cluster offline <resource_name> 


Use the cluster status command to verify that the resource has a status of Offline before you 
continue. 


3 At the command prompt on the non-master node, enter 
/opt/novell/ncs/bin/nes-configd.py -init 


4 Look at the file /var/opt /novell/ncs/resource-priority.conf to verify that it has the same 
information (REVISION and NUMRESOURCES) as the file on the master node. 


5 Delete the LVM volume on the master node by using NSSMU. 
You can alternatively use the nlvm delete linux volume <1x_volume_name> command. 
5a In NSSMU, select Linux Volumes, then press Enter. 
5b Select the unmounted LVM volume, then press Delete. 


5c Select OK to confirm, then press Enter. 
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6 


7 


10 


12 


13 


14 


15 


In the Tree View in iManager, browse the objects to verify that the following objects were deleted: 
+ LVM resource object (from the Cluster container) 
+ Ifthe LVM volume was NCP-enabled: 
+ Volume object for the LVM volume 
¢ Virtual server for the LVM resource (NCS:NCP Server object) 
Re-initialize the device that contained the LVM volume. 


When NLVM or NSSMU removes the Linux LVM volume group, it leaves the device in an 
uninitialized state. 


7a In NSSMU, select Devices, then press Enter. 

7b Select the device, then press F3 (Initialize). 

7c Press y (Yes) to confirm. 

7d Select the partitioning scheme as DOS or GPT, then press Enter. 


On the master node, log in as the root user, open a terminal console, then enter 
/opt/novell/nces/bin/nes-configd.py -init 


Look at the file /var/opt /novell/ncs/resource-priority.conf to verify that it has the same 
information (REVISION and NUMRESOURCES) as that of the non-master node where you 
deleted the cluster resource. 


In iManager, select Clusters > My Clusters, select the cluster, then select the Cluster Options 
tab. 


Click Properties, select the Priorities tab, then click Apply on the Priorities page. 


At a command prompt, enter 
cluster view 


The cluster view should be consistent. 


Look at the file /var/opt /novell/ncs/resource-priority.conf on the master node to verify 
that the revision number increased. 


If the revision number increased, skip Step 14. 


If the deleted resource is the only one in the cluster, the priority won't force the update. A 
phantom resource might appear in the interface. You need to restart Cluster Services to force the 
update, which also removes the phantom resource. 


If the revision number did not automatically update in the previous steps, restart Novell Cluster 
Services by entering the following on one node in the cluster: 


cluster restart [seconds] 


For seconds, specify a value of 60 seconds or more. 


For example: 
cluster restart 120 


(Optional) Use a third-party SAN management tool to assign the devices to only the desired 
server. 
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13.13 Linux LVM Management Tools 


LVM tools are available in the YaST Expert Partitioner and in native Linux command line commands. 


¢ Section 13.13.1, “Using the YaST Expert Partitioner,” on page 396 
¢ Section 13.13.2, “Using LVM Commands,” on page 396 


13.13.1 Using the YaST Expert Partitioner 


You can access the LVM tools in the YaST Expert Partitioner by using the desktop menus, or enter 
the following in a terminal console: 


yast2 disk 


For information about using the Partitioner, see “LVM Configuration” (http:/Avww.suse.com/ 
documentation/sles11/stor_admin/data/Ivm.html) in the SLES 11 SP2: Storage Administration Guide 
(http://www.suse.com/documentation/sles11/stor_admin/data/bookinfo.html). 


13.13.2 Using LVM Commands 
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For information about using LVM commands, see the man pages for the commands described in 
Table 13-1. Perform the commands as the root user. 


Table 13-1 LVM Commands 


Command Description 


pvcreate <device> Initializes a device (Such as /dev/sdb) for use by 
LVLM as a physical volume. 


pvdisplay <device> Displays information about the LVM physical volume, 
such as whether it is currently being used in a logical 
volume. 

vgcreate -c y <vg name> <dev1> [dev2...] Creates a clustered volume group with one or more 


specified devices. 


vgchange -a [ey | n] <vg_name> Activates (-a ey) or deactivates (-a n) a volume 
group and its logical volumes for input/output. 


IMPORTANT: Ensure that you use the ey option to 
exclusively activate a volume group on a cluster node. 
This option is used by default in the load script. 


vgremove <vg_name> Removes a volume group. Before using this 
command, remove the logical volumes, then 
deactivate the volume group. 


vgdisplay <vg_name> Displays information about a specified volume group. 


To find the total physical extent of a volume group, 
enter 


vgdisplay vg name | grep "Total PE" 


lvcreate -L size -n <lv_name> <vg_name> Creates a logical volume of the specified size. 
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Command Description 


lvremove</dev/vg_name/lv_name> Removes a logical volume, such as /dev/vg_name/ 
lv name. 


Before using this command, close the logical volume 
by dismounting it with the umount command. 


vgextend <vg name><device> Adds a specified physical volume to an existing 
volume group 


vgreduce <vg_name> <device> Removes a specified physical volume from an existing 
volume group. 


IMPORTANT: Ensure that the physical volume is not 
currently being used by a logical volume. If it is, you 
must move the data to another physical volume by 
using the pvmove command. 


lvextend -L size</dev/vg_name/lv_name> Extends the size of a specified logical volume. 
Afterwards, you must also expand the file system to 
take advantage of the newly available space. 


lvreduce -L size </dev/vg_name/lv_name> Reduces the size of a specified logical volume. 


IMPORTANT: Ensure that you reduce the size of the 
file system first before shrinking the volume, otherwise 
you risk losing data. 


lvrename </dev/vg_name/old_lv_name> </dev/ Renames an existing LVM logical volume in a volume 
vg_name/new_lv_name> group from the old volume name to the new volume 
name. It does not change the volume group name. 
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14.1 


Upgrading and Managing Cluster 
Resources for Linux POSIX Volumes 
with CSM Containers 


Novell Cluster Services for Novell Open Enterprise Server (OES) 11 and later supports cluster 
resources for Linux POSIX volumes that you created with the Enterprise Volume Management 
System (EVMS) and the Cluster Segment Manager (CSM) on OES 2 SP3 or earlier OES servers. 
This section describes how to modify the scripts and cluster settings for the existing resources so 
they can run on OES 11 or later clusters. 


IMPORTANT: Beginning in OES 11, Novell Cluster Services creates LVM volume group resources for 
Linux POSIX file systems. To create new resources, see Chapter 13, “Configuring and Managing 
Cluster Resources for Shared LVM Volume Groups,” on page 327. 


¢ Section 14.1, “Requirements for Using CSM Cluster Resources,” on page 399 
¢ Section 14.2, “Identifying CSM-Based Resources,” on page 400 
¢ Section 14.3, “Deporting the CSM Containers with Segment Managers,” on page 401 


¢ Section 14.4, “Modifying the Scripts for CSM Resources without a Segment Manager,” on 
page 402 


¢ Section 14.5, “Modifying the Scripts for CSM Resources with a Segment Manager,” on page 407 
¢ Section 14.6, “Configuring and Adding OES 11x Nodes to the OES 2 SP3 Cluster,” on page 415 


¢ Section 14.7, “Configuring the Preferred Nodes and Cluster Settings for a CSM Cluster 
Resource,” on page 415 


¢ Section 14.8, “Verifying the Load and Unload Scripts,” on page 417 
¢ Section 14.9, “Creating an NCP Virtual Server Object for a CSM Cluster Resource,” on page 417 


¢ Section 14.10, “Deleting a Cluster Resource,” on page 420 


Requirements for Using CSM Cluster Resources 


On OES 1 and OES 2 clusters, a cluster resource for a shared Linux POSIX volume used the 
Enterprise Volume Management System (EVMS) utility to add a Cluster Segment Manager (CSM) on 
the device. Because EVMS is deprecated in SUSE Linux Enterprise Server 11, it is not available in 
OES 11 and later (OES 11x). 


Novell Cluster Services on OES 11x provides compatibility support for these CSM-based cluster 
resources. It has been modified in the following ways to allow you to move clustered Linux POSIX file 
systems from OES 2 SP3 nodes to OES 11x nodes in a mixed-mode cluster, and use them after 
upgrading the cluster: 


¢ Recognizes and supports the EVMS-based file system structure. 
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+ Provides a way for managing a resource in the load, unload, and monitor scripts on OES 11x 
clusters that works with its existing EVMS device and segment structure. 


+ Changes the device path from /dev/evms/ to /dev/mapper/, which is the same location where 
LVM devices are stored. 


The Cluster Segment Manager Import/Export (CSMPORT, csmport) utility provides script commands 
that make it possible to use the CSM resources. The commands activate, deactivate, or check the 
status of the CSM container. You must add csmport commands in resource’s the load script, unload 
script, and monitor script before you bring the resource online on OES 11x servers during a cluster 
upgrade. For information about the utility commands that are used in the scripts, see Section A.6, 
“CSMPORT Utility (Cluster Segment Manager Import/Export),” on page 460, or see the csmport (8) 
man page. 


A mixed-mode cluster is supported as a temporary configuration scenario for converting an OES 2 
SP3 cluster to an OES 11x cluster. After the CSM-based resource is configured to run in compatibility 
mode on OES 11x, it should fail over only to the OES 11x nodes in the mixed-mode cluster. See 
Section 7.1.2, “Linux POSIX File Systems on an EVMS CSM (Compatibility Only),” on page 106. 


You cannot create new CSM-based cluster resources on OES 11x clusters. For new Linux POSIX 
volume resources, you must use the Linux Logical Volume Manager (LVM) volume groups as 
described in Chapter 13, “Configuring and Managing Cluster Resources for Shared LVM Volume 
Groups,” on page 327. 


Identifying CSM-Based Resources 


Table 14-1 lists the typical cluster resources for OES 2 SP3 and identifies whether the resource might 
manage a Linux POSIX file system on a on a CSM container. After you identify the resources on your 
OES 2 SP3 cluster, continue with Section 14.3, “Deporting the CSM Containers with Segment 
Managers,” on page 401. Do not add OES 11x nodes to the OES 2 SP3 cluster at this time. 


Table 14-1 OES 2 SP3 Cluster Resources that Manage Linux POSIX File Systems on CSM Containers 
OES 2 SP3 Cluster Resources Uses a Linux POSIX file system on a CSM 
container in OES 2 SP3 


Archive and Version Services Yes 


The cluster resource manages a clustered Linux 
POSIX volume for the PostgreSQL database and a 
clustered NSS pool and volume for the Archive 


volume. 
DFS VLDB No 
(Distributed File Services volume location database) 
DHCP Server Possible 


The DHCP resource template supports using either an 
NSS volume or Linux POSIX volume. Inspect the 
script to determine which type of file system is used. 


DNS Server No 
File, AFP (Apple Filing Protocol) No 
File, CIFS (Windows File Services) No 


400 OES 11 SP3: Novell Cluster Services for Linux Administration Guide 


14.3 


OES 2 SP3 Cluster Resources Uses a Linux POSIX file system on a CSM 
container in OES 2 SP3 


File, FTP No 
File, NetStorage No 
File, Samba Yes 
iFolder 3.9 Yes 
iPrint Yes 
MySQL Yes 
QuickFinder (Server Synchronization Feature) No 


Storage, DST shadow volumes built with NSS volumes No 


Storage, Linux POSIX file system on a CSM Yes, based on a Generic_FS template 
containers 

Storage, NCP volumes Yes, based on a Generic_FS template 
Storage, NSS pools and volumes No 

Xen virtual machines No 


Deporting the CSM Containers with Segment 
Managers 


If a resource’s CSM container does not have a segment manager, it contains a single volume, and the 
CSMPORT utility automatically converts the volume to a compatibility volume and deports the CSM 
container. If a resource’s CSM container has a segment manager on it, you must manually convert 
the Linux POSIX volumes in the container to compatibility volumes, and then deport the container by 
using the EVMS GUI. Special handling is also required to convert the scripts for CSM resources with 
a segment manager on them. 


IMPORTANT: A CSM container must have its volumes converted and be deported in order to work in 
compatibility mode on OES 11x nodes. 


Having a segment manager on the CSM container is not a typical configuration. In an OES 2 cluster, 
you might have added a segment manager on a CSM container in order to be able to create multiple 
volumes in the container as described in “Adding a Segment Manager to the CSM Container” in the 
OES 2 SP3: Novell Cluster Services 1.8.8 Administration Guide for Linux. 


Check each of the CSM containers to determine if it contains a segment manager, and if it does, how 
many volumes it contains. If a resource’s CSM container contains a segment manager, convert the 
container’s volumes to compatibility volumes, then deport the container. If a resource’s CSM 
container does not contain a segment manager, continue with Section 14.4, “Modifying the Scripts for 
CSM Resources without a Segment Manager,” on page 402. 


Before you add OES 11x nodes to an OES 2 SP3 cluster, perform the following for each CSM cluster 
resource: 


1 Log in as the root user on the OES 2 SP3 server in the cluster where the Linux POSIX volume 
cluster resource is online, then open a terminal console. 
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If the resource is offline, log in to an OES 2 SP3 node in the resource’s Preferred Nodes list, then 
bring the resource online by entering 


cluster online <resource_name> 
2 Launch the EVMSGUI utility by entering 
evmsgui 


3 Check to see if the CSM container has a segment manager on it, then do one of the following: 


+ Ifthe CSM container has a segment manager, determine which volumes are on it, then 
continue with the next step. 


+ If aresource’s CSM container does not have a segment manager, it has only a single 
volume and it is not necessary to convert the volume or deport the container. Continue with 
Section 14.4, “Modifying the Scripts for CSM Resources without a Segment Manager,” on 
page 402. 


4 Convert each volume in the CSM container to a compatibility volume: 

4a Select the Volumes tab. 

4b Unmount the volume. 

4c Right-click the volume and select Convert to Compatibility Volume. 

4d Click Convert. 

4e Click Save to save all of the changes. 

4f Repeat Step 4a through Step 4e for each volume in the CSM container. 
5 Modify the CSM container’s properties to set its type to Deported: 

5a Select the Containers tab. 

5b Right-click the container and select Modify Properties. 

5c Select the container, then click Next. 

5d Select Type and change it to Deported. 

5e Click Modify, then click OK to confirm the change. 

5f Click Save to save the container type change. 


6 Repeat the previous steps for each CSM resource in the OES 2 SP3 cluster that manages a 
clustered Linux POSIX volume. 


7 Continue with Section 14.5, “Modifying the Scripts for CSM Resources with a Segment 
Manager,” on page 407. 


14.4 Modifying the Scripts for CSM Resources without 
a Segment Manager 


Before you add OES 11x nodes to an OES 2 SP3 cluster, you must take all of the CSM-based 
resources offline on the OES 2 SP3 nodes in the cluster. Modify their scripts to run on OES 11x nodes 
by adding csmport commands to activate, deactivate, or check the status of the CSM container. After 
you modify the scripts, the resources cannot be used on OES 2 SP3 nodes. They can be mounted 
successfully only on OES 11x nodes in the cluster. 
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IMPORTANT: If the CSM container for your cluster resource has a segment manager on it, follow the 
instructions in Section 14.3, “Deporting the CSM Containers with Segment Managers,” on page 401, 
then go to Section 14.5, “Modifying the Scripts for CSM Resources with a Segment Manager,” on 
page 407. 


The sample scripts in this section use the following sample parameters. Ensure that you replace the 
sample values with your values. 


Parameter Sample Value 
RESOURCE_IP 10.10.10.44 
MOUNT_FS ext3 
CONTAINER_NAME csm44 
MOUNT_DEV /dev/mapper/csm44 
MOUNT_POINT /mnt/lxvol44 


IMPORTANT: Perform the following tasks to prepare the CSM resources for an OES 11x node in a 
mixed-mode cluster. Do not add the OES 11x nodes at this time. 


¢ Section 14.4.1, “Offlining the CSM Cluster Resources without Segment Managers,” on page 403 


¢ Section 14.4.2, “Configuring Scripts for a CSM Cluster Resource without a Segment Manager,” 
on page 404 


¢ Section 14.4.3, “Sample Load Script for a CSM Resource without a Segment Manager,” on 
page 405 


¢ Section 14.4.4, “Sample Unload Script for CSM Resource without a Segment Manager,” on 
page 406 


¢ Section 14.4.5, “Sample Monitor Script fora CSM Resource without a Segment Manager,” on 
page 407 


Offlining the CSM Cluster Resources without Segment 
Managers 


Offline every OES 2 SP3 cluster resource that manages a Linux POSIX file system on CSM 
containers without segment managers: 

1 In iManager, select Clusters > My Clusters. 

2 Select the cluster you want to manage. 


3 On the Cluster Manager page, select the check box next to each of the CSM-based cluster 
resources, then click Offline. 


4 Continue with Section 14.4.2, “Configuring Scripts for a CSM Cluster Resource without a 
Segment Manager,” on page 404. 
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14.4.2 Configuring Scripts for a CSM Cluster Resource without a 
Segment Manager 
In iManager, select Clusters > My Clusters. 


Select the cluster you want to manage. 


Select Cluster Options. 


Bh OU N FP 


Select the check box next to the CSM resource, then click the Details link to view its properties. 
You can also click the CSM resource’s name link to view its properties. 

5 Click the Scripts tab to view the Load Script page. 

6 On the Load Script page, modify the script to add a csmport command to activate the CSM 
container, then click Apply. 


#activate the container 
exit_on_error csmport -i SCONTAINER_NAME 


If the path to the mount point does not exist on OES 11x nodes, you can add a line to create the 
mount point path in the script before the line that mounts the file system: 


# create the mount point path when loading on a new node 
ignore_error mkdir -p SMOUNT_POINT 


For an example, see Section 14.4.3, “Sample Load Script for a CSM Resource without a 
Segment Manager,” on page 405. 

7 Click the Unload Script link to go to the Upload Script page, modify the script to add a csmport 
command to deactivate the CSM container, then click Apply. 


#deactivate the container 
exit_on_error csmport -e S$CONTAINER_NAME 


For an example, see Section 14.4.4, “Sample Unload Script for CSM Resource without a 
Segment Manager,” on page 406. 

8 Click the Monitor Script link to go to the Monitor Script page, modify the script to add a csmport 
command to check the status of the CSM container, then click Apply. 


#check the container 
exit_on_error csmport -c S$CONTAINER_NAME 


For an example, see Section 14.4.5, “Sample Monitor Script for a CSM Resource without a 
Segment Manager,” on page 407. 


9 Repeat Step 3 to Step 8 for each of the resources that you took offline in Section 14.4.1, 
“Offlining the CSM Cluster Resources without Segment Managers,” on page 403. 


Do not bring the CSM cluster resources online again until OES 11x nodes have joined the 
cluster, and each resource’s Preferred Nodes list has been modified to use only OES 11x nodes. 


10 Continue with Section 14.6, “Configuring and Adding OES 11x Nodes to the OES 2 SP3 Cluster,” 
on page 415. 
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14.4.3 


Sample Load Script for a CSM Resource without a Segment 
Manager 


Use the following sample load script to complete the fields for your CSM cluster resource on OES 


11x: 
#!/bin/bas 
/opt/nov 


RESOURCE I 


#define th 


MOUNT _DEV= 


#activate 


# add the 


h 
ell/nes/lib/nesfuncs 


# define the IP address 


P=10.10.10.44 


# define the file system type 
MOUNT _FS=ext3 


e container name 


CONTAINER NAME=csm44 
# define the device 


/dev/mapper/$CONTAINER_NAME 


# define the mount point 
MOUNT_POINT=/mnt/1xvol44 


the container 


exit_on_error csmport -i SCONTAINER NAME 


# create the mount point path when loading on a new node 
ignore_error mkdir -p $MOUNT_POINT 


# mount the file system 
exit_on_error mount_fs SMOUNT_DEV SMOUNT_POINT SMOUNT_FS 


IP address 


exit_on_error add_secondary ipaddress $RESOURCE_IP 


exit 0 
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14.4.4 Sample Unload Script for CSM Resource without a Segment 
Manager 


Use the following sample unload script to complete the fields for your CSM cluster resource on OES 
11x: 


#!/bin/bash 
/opt/novell/ncs/lib/ncsfuncs 


# define the IP address 

RESOURCE IP=10.10.10.44 

# define the file system type 

MOUNT _FS=ext3 

#define the container name 

CONTAINER NAME=csm44 

# define the device 

MOUNT _DEV= /dev/ mapper / SCONTAINER_NAME 
# define the mount point 
MOUNT_POINT=/mnt / lxvol44 


# del the IP address 
ignore_error del_secondary_ipaddress SRESOURCE_IP 


#unmount the volume 
exit_on_error umount_fs S$MOUNT_DEV $MOUNT_POINT $MOUNT_FS 


#deactivate the container 
exit_on_error csmport -e SCONTAINER NAME 


# return status 
exit 0 
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14.4.5 


14.5 


Sample Monitor Script for a CSM Resource without a 
Segment Manager 


Use the following sample monitor script to complete the fields for your CSM cluster resource on OES 
11x. To use the script, you must also enable monitoring for the resource. See Section 10.7, “Enabling 
Monitoring and Configuring the Monitor Script,” on page 208. 


#!/bin/bash 
. /opt/novell/nces/lib/nesfuncs 


# define the IP address 

RESOURCE IP=10.10.10.44 

# define the file system type 

MOUNT _FS=ext3 

#define the container name 

CONTAINER NAME=csm44 

# define the device 

MOUNT _DEV= /dev/ mappe r/$ CONTAINER NAME 
# define the mount point 
MOUNT_POINT=/mn t/lxvol44 


#check the IP address 
exit_on_error status_secondary ipaddress $RESOURCE_IP 


#check the volume 
exit_on_error status_fs SMOUNT_DEV $MOUNT_POINT $SMOUNT_FS 


#check the container 
exit _on_error csmport -c SCONTAINER_ NAME 


# return status 
exit 0 


Modifying the Scripts for CSM Resources witha 
Segment Manager 


Before you add OES 11x nodes to an OES 2 SP3 cluster, you must take all of the CSM-based 
resources offline on the OES 2 SP3 nodes in the cluster. Modify their scripts to run on OES 11x nodes 
by adding csmport commands to activate, deactivate, or check the status of the CSM container. After 
you modify the scripts, the resources cannot be used on OES 2 SP3 nodes. They can be mounted 
successfully only on OES 11x nodes in the cluster. 


If the CSM container has a segment manager on it, you must first convert the volumes in the 
container to compatibility volumes and deport them before you offline them and modify their scripts 
for OES 11 and later. See Section 14.3, “Deporting the CSM Containers with Segment Managers,” on 
page 401. 


IMPORTANT: If the CSM container does not have a segment manager on it, follow the instructions in 
Section 14.4, “Modifying the Scripts for CSM Resources without a Segment Manager,” on page 402. 


If the CSM container has a segment manager on it, the container can have one or more volumes in it. 
The volume device name for each volume is based on its order in the container and whether the 
device is multipathed. The partitions for the volumes in the container are named by adding a 
sequential number to the end of the container name. For example: 
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/dev/mapper/<container_name>1 
/dev/mapper/<container name>2 
and so on. 


If the container name ends with a number, the partitions are named by adding a p before the 
sequential number. For example: 


/dev/mapper/<container name>p1l 
/dev/mapper/<container_name>p2 
and so on. 


In addition to adding the csmport commands to the scripts, you must modify the definition fields in the 
scripts to have one entry for each of the volumes. 


The sample scripts in this section use the following sample parameters. It assumes that the CSM 
container has a DOS segment manager on it and two Linux POSIX volumes with different file 
systems. Ensure that you replace the sample values with your values. 


Parameter Sample Value 

volume name for Linux POSIX volume 1 Ixvolext3 

volume name Linux POSIX volume 2 Ixvolxfs 

RESOURCE_IP 10.10.10.44 

MOUNT_FS1 ext3 

MOUNT_FS2 xfs 

CONTAINER_NAME csm4 

VOLUME_DEV1 csm44p1 

VOLUME _DEV2 csm44p2 

MOUNT_DEV1 /dev/mapper/$VOLUME_DEV1 
MOUNT_DEV2 /dev/mapper/$VOLUME_DEV2 
MOUNT_POINT1 /mnt/lxvol44ext3 
MOUNT_POINT2 /mnt/lxvol44xfs 


IMPORTANT: Perform the following tasks to prepare the CSM resources for an OES 11x node in a 
mixed-mode cluster. Do not add the OES 11x nodes at this time. 


¢ Section 14.5.1, “Offlining the CSM Cluster Resources with a Segment Manager,” on page 409 


¢ Section 14.5.2, “Configuring the Scripts for a CSM Cluster Resource with a Segment Manager,” 
on page 409 


¢ Section 14.5.3, “Sample Load Script for a CSM Resource with a Segment Manager,” on 
page 412 


¢ Section 14.5.4, “Sample Unload Script for a CSM Resource with a Segment Manager,” on 
page 413 


¢ Section 14.5.5, “Sample Monitor Script fora CSM Resource with a Segment Manager on It,” on 
page 414 
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14.5.1 


14.5.2 


Offlining the CSM Cluster Resources with a Segment 
Manager 


Offline every OES 2 SP3 cluster resource that manages a Linux POSIX file system on CSM 
containers with segment managers: 
1 In iManager, select Clusters > My Clusters, select the cluster, then click Cluster Manager. 


2 Select the check box next to each of the CSM-based cluster resources that you want to manage, 
then click Offline. 


Wait until the resources report an Offline status. 


3 Continue with Section 14.5.2, “Configuring the Scripts for a CSM Cluster Resource with a 
Segment Manager,” on page 409. 


Configuring the Scripts for a CSM Cluster Resource witha 
Segment Manager 
In iManager, select Clusters > My Clusters. 


Select the cluster you want to manage. 


Select Cluster Options. 


Bh OU N FP 


Select the check box next to the CSM resource, then click the Details link. 
You can also click the CSM resource’s name link to view its properties. 


ol 


Click the Scripts tab to view the Load Script page. 


6 On the Load Script page, modify the script to handle the CSM container and multiple volumes on 
it. 


For an example, see Section 14.5.3, “Sample Load Script for a CSM Resource with a Segment 
Manager,” on page 412. 


6a Add file system definition entries for each file system used by the volumes. 
For example, if you have two volumes and each of them has a different type of file system, 
you create a definition for each: 


#define the file system types 
MOUNT _FS1=ext3 
MOUNT _FS2=xfs 


6b Add a device definition for each volume: 


#define the volume devices 
VOLUME DEV1=csm44p1 
VOLUME DEV2=csm44p2 


6c Add a mount device definition for each volume: 


#define the devices 
MOUNT_DEV1=/dev/mapper/$VOLUME_DEV1 
MOUNT_DEV2=/dev/mapper/S$VOLUME_DEV2 


6d Add a mount point definition for each volume: 


#define the mount points 
MOUNT_POINT1=/mnt/1xvolext3 
MOUNT_POINT2=/mnt/1xvolxfs 
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6e Add acsmport command to activate the CSM container: 


#activate the container 


exit_o 


n_error csmport -i SCONTAINER_NAME 


6f Add a kpartx command to activate the partitions. The command should follow the csmport 
command in the load script. 


#activate the partitions 


exit_o 


6g If youu 


n_error /sbin/kpartx -a /dev/mapper/SCONTAINER_NAME 


se a mkdir command, create one for each mount point: 


#if the mount path does not exist, create it 


ignore 
ignore 


error mkdir -p SMOUNT_POINT1 
error mkdir -p $MOUNT_POINT2 


6h Add amount command for each volume: 


#mount 
exit_o 
exit_o 


the file systems 
n_error mount _fs SMOUNT_DEV1 S$MOUNT_POINT1 SMOUNT_FS1 
n_error mount _fs SMOUNT_DEV2 SMOUNT_POINT2 SMOUNT_FS2 


6i Click Apply to save the load script changes. 


7 Click the Un 


load Script link to go to the Unload Script page, then modify the script to handle the 


CSM container and multiple volumes on it. 


For an example, see Section 14.5.4, “Sample Unload Script for a CSM Resource with a 
Segment Manager,” on page 413. 


7a Modify the definitions as described in Step 6a through Step 6d in the load script changes. 


#defin 


MOUNT_ 
MOUNT _ 


#defin 


e the file system types 
FS1=ext3 
FS2=xfs 


e the container name 


CONTAINER NAME=csm44 


#defin 


e the volume devices 


VOLUME DEV1=csm44p1 
VOLUME DEV2=csm44p2 


#define the devices 
MOUNT_DEV1=/dev/mapper/S$VOLUME_DEV1 
MOUNT_DEV2=/dev/mapper/S$VOLUME_DEV2 


#define the mount points 


MOUNT _ 
MOUNT _ 


7b Add an 


#unmMoU. 
exit_o 
exit_o 


POINT1=/mnt/1lxvolext3 
POINT2=/mnt/1lxvolxfs 


unmount command for each volume: 


nt the volumes 
n error umount _fs SMOUNT_DEV1 SMOUNT_POINT1 SMOUNT_FS1 
n error umount _fs SMOUNT_DEV2 $MOUNT_POINT2 SMOUNT_FS2 


7c Add a kpartx command to deactivate the partitions. The command should come before the 


csmpor 


t command in the unload script. 


#deactivate the partitions 


exit_o 
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7d Add a csmport command to deactivate the CSM container: 


#deactivate the container 


exit_on_error csmport -e SCONTAINER_ NAME 


7e Click Apply to save the unload script changes. 


8 Click the Monitor Script link to go to the Monitor Script page, then modify the script to handle the 


9 Repeat Step 5 to Step 8 for each of the resources that you took offline in Section 14.4.1, 
“Offlining the CSM Cluster Resources without Segment Managers,” on page 403. 


10 
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CSM container and multiple volumes on it. 


For an example, see Section 14.5.5, “Sample Monitor Script fora CSM Resource with a 
Segment Manager on It,” on page 414. 


#define the file system types 
MOUNT _FS1=ext3 
MOUNT _FS2=xfs 


#define the container name 
CONTAINER NAME=csm44 


#define the volume devices 
VOLUME DEV1=csm44p1 
VOLUME DEV2=csm44p2 


#define the devices 
MOUNT_DEV1=/dev/mapper/$VOLUME_DEV1 
MOUNT _DEV2=/dev/mapper/SVOLUME_DEV2 


#define the mount points 
MOUNT_POINT1=/mnt/1lxvolext3 
MOUNT_POINT2=/mnt/1lxvolxfs 


8b Add a check for each volume: 


#check the volumes 


exit_on_error status fs SMOUNT_DEV1 SMOUNT_POINT1 SMOUNT_FS1 
exit_on_error status _fs S$MOUNT_DEV2 SMOUNT_POINT2 SMOUNT_FS2 


8c Add a csmport command to check the status of the CSM container: 


#check the container 


exit_on_error csmport -c SCONTAINER_ NAME 


8d Click Apply to save the monitor script changes. 


Do not bring the CSM cluster resources online again until OES 11x nodes have joined the 
cluster, and each resource’s Preferred Nodes list has been modified to use only OES 11x nodes. 


Continue with Section 14.6, “Configuring and Adding OES 11x Nodes to the OES 2 SP3 Cluster,” 
on page 415. 


8a Modify the definitions as described in Step 6a through Step 6d in the load script changes. 
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14.5.3 Sample Load Script for a CSM Resource with a Segment 
Manager 


Use the following sample load script to complete the fields for your CSM cluster resource on OES 
11x: 


#!/bin/bash 
/opt/novell/ncs/lib/ncesfuncs 


#define the IP address 
RESOURCE IP=10.10.10.44 


#define the file system types 
MOUNT _FS1=ext3 
MOUNT _FS2=xfs 


#define the container name 
CONTAINER NAME=csm44 


#define the volume devices 
VOLUME DEV1=csm44p1 
VOLUME DEV2=csm44p2 


#define the devices 
MOUNT _DEV1=/dev/mapper/$VOLUME_DEV1 
MOUNT_DEV2=/dev/mapper/SVOLUME_DEV2 


#define the mount points 
MOUNT_POINT1=/mnt/1xvolext3 
MOUNT_POINT2=/mnt/1lxvolxfs 


#if the mount path does not exist, create it 
ignore_error mkdir -p S$MOUNT_POINT1 
ignore_error mkdir -p SMOUNT_POINT2 


#activate the container 
exit_on_error csmport -i SCONTAINER_ NAME 


#activate the partitions 
exit_on_error /sbin/kpartx -a /dev/mapper/S$CONTAINER_NAME 


#mount the file systems 
exit_on_error mount_fs S$MOUNT_DEV1 $MOUNT_POINT1 $MOUNT_FS1 
exit_on_error mount_fs SMOUNT_DEV2 SMOUNT_POINT2 SMOUNT_FS2 


# add the IP address 
exit_on_error add_secondary_ipaddress SRESOURCE_IP 


exit 0 
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14.5.4 


Sample Unload Script for a CSM Resource with a Segment 


Manager 


Use the following sample unload script to complete the fields for your CSM cluster resource on OES 


11x: 


#!/bin/bash 
/opt/novell/ncs/lib/ncsfuncs 


# define the IP address 
RESOURCE IP=10.10.10.44 


# define the file system types 
MOUNT _FS1=ext3 
MOUNT _FS2=xfs 


#define the container name 
CONTAINER NAME=csm44 


#define the volume devices 
VOLUME DEV1=csm44p1 
VOLUME DEV2=csm44p2 


#define the devices 
MOUNT _DEV1=/dev/mapper/$VOLUME_DEV1 
MOUNT_DEV2=/dev/mapper/SVOLUME_DEV2 


#define the mount points 
MOUNT_POINT1=/mnt/1xvolext3 
MOUNT_POINT2=/mnt/1lxvolxfs 


#del the IP address 
ignore_error del_secondary_ipaddress $SRESOURCE_IP 


#unmount the volumes 


exit_on_error umount_fs SMOUNT_DEV1 SMOUNT_POINT1 SMOUNT_FS1 
exit_on_error umount_fs S$MOUNT_DEV2 $MOUNT_POINT2 $MOUNT_FS2 


#deactivate the partitions 


exit_on_error /sbin/kpartx -d /dev/mapper/S$CONTAINER_NAME 


#deactivate the container 
exit_on_error csmport -e SCONTAINER NAME 


# return status 
exit 0 
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14.5.5 Sample Monitor Script fora CSM Resource with a Segment 
Manager on It 


Use the following sample monitor script to complete the fields for your CSM cluster resource on OES 
11x. To use the script, you must also enable monitoring for the resource. See Section 10.7, “Enabling 
Monitoring and Configuring the Monitor Script,” on page 208. 


#!/bin/bash 
/opt/novell/ncs/lib/nesfuncs 


# define the IP address 
RESOURCE IP=10.10.10.44 


# define the file system types 
MOUNT _FS1=ext3 
MOUNT _FS2=xfs 


#define the container name 
CONTAINER NAME=csm44 


#define the volume devices 
VOLUME DEV1=csm44p1 
VOLUME DEV2=csm44p2 


#define the devices 
MOUNT_DEV1=/dev/mapper/S$VOLUME_DEV1 
MOUNT_DEV2=/dev/mapper/S$VOLUME_DEV2 


#define the mount points 
MOUNT_POINT1=/mnt/1xvolext3 
MOUNT_POINT2=/mnt/1lxvolxfs 


#check the IP address 
exit_on_error status_secondary ipaddress $RESOURCE_ IP 


#check the volumes 
exit_on_error status_fs SMOUNT_DEV1 SMOUNT_POINT1 SMOUNT_FS1 
exit_on_error status_fs S$MOUNT_DEV2 $MOUNT_POINT2 $MOUNT_FS2 


#check the container 
exit_on_error csmport -c SCONTAINER_ NAME 


# return status 
exit 0 


414 OES 11 SP3: Novell Cluster Services for Linux Administration Guide 


14.6 


14.7 


Configuring and Adding OES 11x Nodes to the 
OES 2 SP3 Cluster 


Configure Novell Cluster Services on an OES 11x server, join the node to the cluster, then add a line 
for each of the CSM containers in its /etc/opt /novell/nss/nlvm.conf file. Do not bring the CSM 
resources online at this time. 


1 Prepare an OES 11x server for the cluster, but do not allow it to join the cluster. On page 3 of the 
Cluster Services Configuration in YaST2, ensure that you deselect (disable) the check box for 
Start Cluster Services now. 


Use chkconfig novell-ncs off before rebooting to the SLES11 SPx Installation CD. This 
prevents Cluster Services from starting automatically after reboots. 


IMPORTANT: Do not start cluster services on this node or join the OES 2 SP3 cluster, until after 
all of the Linux POSIX cluster resources have been taken offline. 


For information about configuring the OES 11x node for the existing OES 2 SP3 cluster, see 
Step 2 in Section 7.4, “Adding OES 11x Nodes to an OES 2 SP3 Cluster (Rolling Cluster 
Upgrade),” on page 109. 


2 Log in as the root user on the OES 11x server, then open a terminal console. 
3 Add the OES 11x server to the OES 2 SP3 cluster by entering 


cluster join 


4 Ina text editor, add the following line for each CSM container to the /etc/opt/novell/nss/ 
nlvm. conf file on the OES 11x node, then save the file. 


Include devices /dev/mapper/<container_ name> 


Replace container_name with the name of the CSM container for the Linux POSIX volume. 


5 Continue with Section 14.7, “Configuring the Preferred Nodes and Cluster Settings for a CSM 
Cluster Resource,” on page 415. 


Configuring the Preferred Nodes and Cluster 
Settings for a CSM Cluster Resource 


After you have modified the CSM cluster resources’ scripts and added at least one OES 11x node to 
the cluster, the CSM resources are ready to run only on OES 11x nodes in the cluster. You must 
modify the preferred nodes for each cluster resource so that it fails over only to other nodes running 
OES 11x. You should also disable the Resource Follows Master option until the upgrade is complete 
and all of the OES 2 SP3 nodes have left the cluster. The most preferred node is the first server in the 
Preferred Nodes list for the resource. 


NOTE: Resources fail back only to the first node in their Preferred Nodes list. So if a resource has 
failed over to three servers since it originally ran on its preferred node, and the second server the 
resource was running on comes back up, the resource will not failback to that second server. 


Resources do not automatically move from node to node just because a node higher in the Preferred 
Nodes list rejoins the cluster, unless the Failback mode is set to AUTO and the first node in the 
Preferred Nodes list rejoins the cluster. 
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To verify the policy settings and modify the preferred nodes: 
1 Ensure that you have offlined the CSM resources from OES 2 SP3 nodes and converted the 
load, unload, and monitor scripts as described in the following: 


+ Section 14.4, “Modifying the Scripts for CSM Resources without a Segment Manager,” on 
page 402 


+ Section 14.5, “Modifying the Scripts for CSM Resources with a Segment Manager,” on 
page 407 


2 Ensure that you have added one or more OES 11x nodes to the OES 2 SP3 cluster as described 
in Section 14.6, “Configuring and Adding OES 11x Nodes to the OES 2 SP3 Cluster,” on 
page 415, but do not bring the CSM resources online at this time. 


3 In iManager, select Clusters > My Clusters, then select the cluster. 
4 Click the cluster resource name to open its properties pages. 


5 Ina mixed-mode cluster, deselect the Resource Follows Master check box to prevent the 
resource from inadvertently trying to fail over to a non-OES 11 node. 


After the conversion to OES 11x is finalized (no longer a mixed-mode cluster), you can enable 
this option if you want the resource to always run on the master node. If the master node in the 
cluster fails, the resource fails over to whichever node becomes the master. 


6 (Optional) Select the Ignore Quorum check box if you don't want the cluster-wide timeout period 
and node number limit enforced. 


The quorum default values were set when you installed Novell Cluster Services. You can change 
the quorum default values by accessing the properties page for the Cluster object. 


Selecting this box ensures that the resource is launched immediately on any server in the 
Preferred Nodes list as soon as any server in the list is brought online. 


7 Specify the Start, Failover, and Failback modes for this resource. 


The default for both Start and Failover modes is AUTO, and the default for Failback mode is 
DISABLE. 


8 Click Next. 


9 Assign nodes to the resource as described in Section 10.10, “Configuring Preferred Nodes and 
Node Failover Order for a Resource,” on page 216, then click Finished. 


IMPORTANT: Ensure that the preferred nodes list contains only OES 11x nodes. 


10 Configure resource priorities for load order as described in Section 10.11, “Configuring Resource 
Priorities for Load Order,” on page 218. 


11 (Optional) Assign the resource to a Resource Mutual Exclusion Group as described in 
Section 10.12, “Configuring Resource Mutual Exclusion Groups,” on page 219. 


12 Continue with Section 14.8, “Verifying the Load and Unload Scripts,” on page 417. 
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14.8 


14.9 


Verifying the Load and Unload Scripts 


After you have modified the resource scripts, ensure that the load and unload scripts are working. 


1 In iManager, select Clusters > My Clusters, then select the cluster. 


2 On the Cluster Manager page, select the check box next to the new CSM cluster resource, then 
click Online. 


Ensure that the resource successfully enters the Running state. If the resource goes comatose 
instead, it is probably because you made an error when typing values in the script definitions. 
Take the resource offline, go to the resource’s Properties > Scripts page to review and modify its 
scripts as needed to correct errors, then try again to online the resource. 


3 (Optional) Continue with Section 14.9, “Creating an NCP Virtual Server Object for a CSM Cluster 
Resource,” on page 417. 


Creating an NCP Virtual Server Object for a CSM 
Cluster Resource 


Having an NCP virtual server object allows the Linux POSIX volume cluster resource to be viewed in 
the Browse panel in iManager. You can also bind the virtual server name to the IP address to allow 
users to access the resource via an assigned name in addition to its IP address. When you cluster- 
enable a Linux POSIX volume on OES 2 SP3, an NCP virtual server object is not created 
automatically as it is when you cluster-enable an NSS pool. 


IMPORTANT: The NcS:NCP Server object does not give users NCP access to the data on a Linux 
POSIX volume. An NCP volume is required to do that. To create NCP volumes on the shared Linux 
POSIX volume, see “Creating a Shared NCP Volume on the Linux POSIX Cluster Resource” in the 
OES 11 SP3: NCP Server for Linux Administration Guide. 


You can use an existing Virtual Server Object that you created before you moved the CSM resource 
to OES 11x. After a conversion is finalized, you can assign a virtual server name to the cluster 
resource by using the /opt/novell/ncs/bin/nes_ncpserv.py Script to create an NCS:NCP Server 
object for it. 


The virtual server name is stored in eDirectory in an NCS:NCP Server object under the Cluster object 
where you created the resource. You must add a line to the load and unload scripts that identifies the 
name of this virtual server and a line that binds or unbinds the name to the IP address of the Linux 
POSIX cluster resource. 

¢ Section 14.9.1, “Creating the Virtual Server Object,” on page 418 

¢ Section 14.9.2, “Modifying the Load Script,” on page 418 

¢ Section 14.9.3, “Modifying the Unload Script,” on page 419 

¢ Section 14.9.4, “Activating the Script Changes,” on page 419 

¢ Section 14.9.5, “Verifying the Virtual Server,” on page 419 
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14.9.1 Creating the Virtual Server Object 


You use the /opt/novell/nes/bin/nes_ncpserv.py script to create a virtual server object 
(NCS:NCP Server) in eDirectory for the Linux POSIX volume cluster resource. If the resource does 
not have NCP volumes on it, you do not use the -v option. For information about the ncs_ncpser.py 
script, see Section A.9, “ncs_ncpserv.py Script (Creating an NCP Virtual Server Object for a 
Clustered LVM Volume Group),” on page 472. 

1 On the master cluster node, open a terminal console, then log in as the root user. 

2 Inthe console, use the cd command to go to the /opt /novell/ncs/bin directory. 


3 At the command prompt, enter 
./nes_ncepserv.py -c 1x_volumename -i resource ip address 


Replace the /x_volumename and resource_ip_address with the information for your particular 
solution. 


Do not use periods in cluster resource names. Novell clients interpret periods as delimiters. If 
you use a space in a cluster resource name, that space is converted to an underscore. 


For example, to create the NCS:NCP Server object for the 1xvo144 cluster resource where the 
IP address is 10.10.10.44 and the cluster context is ou=clusters, ou=city,o=mycompany, enter 
./nes_nepserv.py -c lxvol44 -i 10.10.10.44 


The confirmation message is displayed: 


NCP Server 'cn=cluster1_lxvol44_server,ou=clusters,ou=city,o=mycompany' 
created. 


4 Continue with Section 14.9.2, “Modifying the Load Script,” on page 418 


14.9.2 Modifying the Load Script 


After you have created an NCS:NCP Server object, you must modify the load script so that it binds 
the NCS:NCP Server object to the resource. 
1 In iManager, select Clusters > My Clusters, then select the cluster. 


2 On the Cluster Manager page, click the name link of the Linux POSIX cluster resource to open 
its Cluster Resource Properties page. 


3 Click the Scripts tab to open the Load script. 
4 In the definition area, add the following lines to define the virtual NCP server name: 


# define NCP server name 
NCP_SERVER=clusterl_1xvol44 server 


Replace the NCP server name with the name for your virtual NCP server. 
5 Under the mount line, add a line to bind the NCP server name to the resource IP address: 


# bind the NCP volume 
exit_on_error ncpcon bind --ncpservername=SNCP_ SERVER --ipaddress=SRESOURCE IP 


6 Click Apply to save your changes. 


The script changes are not active until the next time the cluster resource is taken offline, and 
then brought online. Do not active the script changes at this time. 


7 Continue with Section 14.9.3, “Modifying the Unload Script,” on page 419. 


418 OES 11 SP3: Novell Cluster Services for Linux Administration Guide 


14.9.3 Modifying the Unload Script 


After you have created an NCS:NCP Server object, you must modify the unload script so that it 
unbinds the NCS:NCP Server object from the resource. 
1 In iManager, select Clusters > My Clusters, then select the cluster. 


2 On the Cluster Manager page, click the name link of the Linux POSIX cluster resource to open 
its Cluster Resource Properties page. 


3 Click the Scripts tab, then click Unload to open the Unload script. 
4 In the definition area, add the following lines to define the virtual NCP server name: 


# define NCP server name 
NCP_SERVER=clusterl_1xvol44 server 


Replace the NCP server name with the name for your virtual NCP server. Use the same value 
for variable that you did in the load script. 

5 Under the definition, add a line to unbind the NCP server name from the resource IP address: 
# unbind the NCP server name 
ignore error ncpcon unbind --ncpservername=$NCP_SERVER -- 
ipaddress=SRESOURCE_IP 

6 Click Apply to save your changes. 


The script changes are not active until the next time the cluster resource is taken offline, and 
then brought online. 


Continue with Section 14.9.4, “Activating the Script Changes,” on page 419. 


nN 


14.9.4 Activating the Script Changes 


The script changes are not active until the next time the cluster resource is taken offline, and then 
brought online. 
1 In iManager, select Clusters > My Clusters, then select the cluster. 


2 On the Cluster Manager page, select the check box next to the Linux POSIX cluster resource, 
then click Offline. 


Wait until the resource is reports an Offline status before continuing. 

3 Select the check box next to the Linux POSIX cluster resource, then click Online. 
Wait until the resource is reports an Online status before continuing. 

4 Continue with Section 14.9.5, “Verifying the Virtual Server,” on page 419. 


14.9.5 Verifying the Virtual Server 


Verify that an NCS:NCP Server object appears in the Browse panel in iManager. 


1 Inthe iManager toolbar, click the View Objects icon. 
2 In the left panel, click Browse. 


3 Browse to the Cluster container to see the virtual server object for the cluster resource, such as 
clusterl_1lxvol44 server 
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14.10 Deleting a Cluster Resource 


To avoid data corruption, ensure that you offline the cluster resource before attempting to delete it, 
especially if the resource uses shared storage. 


WARNING: Deleting a cluster resource while it is online can result in deletion errors, and the data 
associated with the shared storage is not recoverable. 
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Configuring Novell Cluster Services ina 
Virtualization Environment 


Novell Cluster Services is installed and configured in a virtualization environment by using the same 
methods and processes as those used on a physical Novell Open Enterprise Server (OES) 11 or later 
server. It can be used in the host and guest virtual environments. 


For a virtual machine, you can use any virtualization hypervisor (Such as Xen, KVM, VMware, and 
Hyper-V) that supports the 64-bit SUSE Linux Enterprise Server 11 SP1 or later operating system, 
which is the platform used for OES 11 or later. 


For information about using OES with Xen and KVM, see the following resources: 
+ For information on setting up virtualized OES servers, see “Installing, Upgrading, or Updating 
OES ona VM” in the OES 11 SP3: Installation Guide. 


+ To get started with Xen virtualization, see the Virtualization with Xen documentation (http:// 
www.suse.com/documentation/sles11/book_xen/data/book_xen.html). 


¢ To get started with KVM virtualization, see the Virtualization with KVM documentation (http:// 
www.suse.com/documentation/sles11/book_kvm/data/book_kvm.html). 


¢ To get started with third-party virtualization platforms, such as Hyper-V from Microsoft and the 
different VMware product offerings, refer to the documentation for the product you are using. For 
information about setting up a cluster with nodes hosted on VMware, see OES 11 SP3: Novell 
Cluster Services Implementation Guide for VMware. 


The following sections provide information to help you deploy and run Novell Cluster Services in a 
virtual environment: Although many different cluster virtualization scenarios are possible, only those 
outlined in the following sections have been tested. 

¢ Section 15.1, “Prerequisites for Xen Host Server Environments,” on page 421 

¢ Section 15.2, “Virtual Machines as Cluster Resources,” on page 422 

¢ Section 15.3, “Virtual Machines as Cluster Nodes,” on page 431 

¢ Section 15.4, “Virtual Cluster Nodes in Separate Clusters,” on page 432 

¢ Section 15.5, “Mixed Physical and Virtual Node Clusters,” on page 433 

¢ Section 15.6, “Additional Information,” on page 435 


Prerequisites for Xen Host Server Environments 


You can install Novell Cluster Services on a Xen virtualization host server (Dom0) running OES. You 
can create cluster resources that contain the virtual machine information by using the Xen and 
XenLive resource templates. You can fail over or cluster migrate these virtual machine cluster 
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resources to different physical nodes in your cluster. Only the Xen and XenLive templates can be 
used in the Xen host server environment. You can modify these templates to work with other types of 
hypervisors. 


All templates except Xen and XenLive are valid on guest servers (DomU). When Novell Cluster 
Services is installed on an OES guest server environment, no additional changes or special 
configuration are required. You can create clusters consisting of all virtual nodes, or use a 
combination of virtual and physical nodes. 


When using Novell Cluster Services to create cluster resources in a Xen host server environment, 
one network adapter on each cluster node must be available without Xen bridging to allow Novell 
Cluster Services to monitor for network state changes in the cluster. You need at least one other 
network adapter on each cluster node to use as a bridge for the virtual servers that will be hosted on 
the Xen host. 


For each cluster node, determine which network adapter you want to use for Novell Cluster Services 
communications and network state monitoring, then do the following: 


¢ Disable bridging on the network adapter. 

+ Assign the IP address of the host server to the network adapter. 
For information about why this configuration is necessary, see “TID 7004595: Novell Cluster Services 
is unable to detect a network link down when installed on a Xen domain 0 (dom0O)” (http:// 


www.novell.com/support/viewContent.do?externalld=7004595&sliceld=1) on Novell Support (http:// 
www.novell.com/support). 


Virtual Machines as Cluster Resources 


In this scenario, you have an 


OES 11x cluster configured on physical machines. OES 11x and Xen are installed and configured on 
each node along with Novell Cluster Services. This part of the Novell Cluster Services configuration 
does not differ from that of an OES 11x cluster without virtualization. 


You can create OES virtual machines on each cluster node and configure those virtual machines to 
be cluster resources. You can then fail over or migrate virtual machine cluster resources (entire virtual 
machines) to different physical nodes in your cluster. 


Figure 15-1 depicts how this setup might look. Novell Cluster Services (NCS) is installed and running 
on the virtual machine (VM) host server. 
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Figure 15-1 Virtual Machines as Cluster Resources 
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The following sections describe how to create a cluster resource and its cluster scripts for each virtual 
machine: 


¢ Section 15.2.1, “Creating a Xen Virtual Machine Cluster Resource,” on page 423 
¢ Section 15.2.2, “Configuring Virtual Machine Load, Unload, and Monitor Scripts,” on page 424 
¢ Section 15.2.3, “Setting Up Live Migration,” on page 431 


Creating a Xen Virtual Machine Cluster Resource 


Novell Cluster Services includes two Xen (virtual machine) resource templates, which greatly simplify 
the process for creating a virtual machine cluster resource. Much of the virtual machine cluster 
resource configuration is performed automatically by the Xen resource templates. The two templates 
are named Xen_Template and XenLive_Template. Both templates perform similar functions to 
automatically configure the cluster resource for the virtual machine. 


The XenLive template provides an additional function to allow a manual virtual machine resource 
migration without the need to boot or bring up the virtual machine on the cluster node where the 
virtual machine has been migrated. This lets clients continue to access a virtual machine that has 
been migrated without reconnecting or waiting for the virtual machine to boot or load on the target 
node. 


IMPORTANT: The live migrate function is only useful for a manual virtual machine resource 
migration, and does not work for a virtual machine resource failover or failback. 


Ensure that your Xen setup is working properly before you attempt to set up the Novell Cluster 
Services clustering for your virtual machines in the Xen host environment. Refer to the Virtualization 
with Xen (http://www.suse.com/documentation/sles11/book_xen/data/book_xen.html) to find out how 
to set up XEN and XEN virtual machines. 


To configure a virtual machine as a cluster resource: 


1 Open your Internet browser and enter the URL for iManager. 
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The URL is http://server_ip_address/nps/imanager.html. Replace server_ip_address with the IP 
address or DNS name of a server in the cluster or with the IP address for Apache-based 
services. 


2 Specify your user name and password, specify the tree where you are installing the cluster, then 
click Login. 


3 In iManager, select Clusters > My Clusters, select the cluster, then click Cluster Options. 
4 On the Cluster Options page, click New. 


5 Click the Resource radio button to specify Resource as the resource type you want to create, 
then click Next. 


6 Specify a name for the virtual machine resource. 


7 Inthe Inherit From Template field, browse to the Cluster object container, then select the desired 
Xen template name from the list of templates in the container. 


The Xen templates are named Xen_Template and XenLive_Template. 


8 Select the Define Additional Properties check box, click Next, then continue with “Configuring 
Virtual Machine Load, Unload, and Monitor Scripts” on page 424. 


Configuring Virtual Machine Load, Unload, and Monitor 
Scripts 


The Xen resource templates configure the virtual machine resource by automatically creating load, 
unload, and monitor scripts, setting failover and failback modes, and assigning the virtual machine as 
a resource to all nodes in the cluster. 


The load, unload, and monitor scripts for virtual machine cluster resources do not need to be modified 
if all the following are true: 

+ The resource name is the same as the virtual machine name. 

¢ The configuration file name is the same as the virtual machine name. 

+ The mount point directory name is the same as the virtual machine name. 

+ You are using the Reiser file system. 
If you are not modifying the scripts, continue the setup by configuring the resource policies and the 
resource server assignments. See Section 10.9, “Configuring the Start, Failover, and Failback Modes 


for Cluster Resources,” on page 214 and Section 10.10, “Configuring Preferred Nodes and Node 
Failover Order for a Resource,” on page 216. 


If you are modifying the scripts, continue with the following sections: 


¢ “Configuring the Load Script” on page 424 
+ “Configuring the Unload Script” on page 426 
+ “Configuring the Monitor Script” on page 428 


Configuring the Load Script 


The virtual machine resource load script page should already be displayed. The load script contains 
commands to start the virtual machine. You can customize some commands for your specific 
configuration. 


1 View and, if necessary, edit the lines in the script for your specific directory structure, mount 
point, configuration file, and file system type (in the Xen_Template). 
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See the following examples of the default Xen_Template and XenLive_Template load scripts: 


+ “Sample Xen_Template Load Script” on page 425 
+ “Sample XenLive_Template Load Script” on page 425 
2 Click Next and continue with “Configuring the Unload Script” on page 426. 


Sample Xen_Template Load Script 
The Xen_Template load script appears similar to the following example: 


#!/bin/bash 
/opt/novell/ncs/lib/ncesfuncs 
export OCF _ROOT=/usr/lib/ocf/ 


#define domU name 
OCF RESOURCE INSTANCE=xen_vm_name 


#define shared volume name 
VOLUME _NAME=SOCF_ RESOURCE INSTANCE 


#define the volume group name 

CONTAINER NAME=name 

# define the device 
MOUNT_DEV=/dev/SCONTAINER_NAME/SVOLUME_NAME 


# filesystem settings 

export OCF RESKEY device=SMOUNT_DEV 

export OCF _RESKEY directory=/mnt/$OCF_ RESOURCE INSTANCE 
export OCF_RESKEY fstype=ext3 

#export OCF _RESKEY options= 


# service settings 
export OCF RESKEY xmfile=$OCF_RESKEY directory/SOCF RESOURCE _ INSTANCE 


#activate the volume group 
exit_on_error vgchange -a ey $VOLGROUP_NAME 


# mount the file system 
exit_on_error ocf_start Filesystem 


# start the service 
exit_on_error ocf_start Xen 


# return status 
exit 0 


Sample XenLive_Template Load Script 


The XenLive_Template load script appears similar to the following example: 
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#!/bin/bash 

. /opt/novell/nes/lib/nesfuncs 
export OCF _ROOT=/usr/lib/ocf/ 

OCF RESOURCE INSTANCE=xen_vm_name 


# filesystem settings 
export OCF _RESKEY directory=/mnt/SOCF_RESOURCE_INSTANCE 


# service settings 
export OCF RESKEY xmfile=$OCF_RESKEY directory/SOCF RESOURCE_INSTANCE 


# start the service 
if [ -n "SNCS_TOFROM" ] 
then 
exit_on_error ocf_migrate from Xen 
else 
exit_on_error ocf_start Xen 
fi 


# return status 
exit 0 


Configuring the Unload Script 


The virtual machine resource unload script page should now be displayed. The unload script contains 
commands to stop the virtual machine. You can customize some commands for your specific 
configuration. 


1 View and, if necessary, edit the lines in the script for your specific directory structure, mount 
point, configuration files, and file system type (in the Xen_Template). 
Use the same values that you specified in the load script. 
See the following examples of the default Xen_Template and XenLive_Template unload scripts: 
+ “Sample Xen_Template Unload Script” on page 426 
+ “Sample XenLive_Template Unload Script” on page 428 


2 Click Next, then continue the setup by configuring the resource policies and the resource server 
assignments. 


See Section 10.9, “Configuring the Start, Failover, and Failback Modes for Cluster Resources,” 
on page 214 and Section 10.10, “Configuring Preferred Nodes and Node Failover Order for a 
Resource,” on page 216. 


3 If you want to enable monitoring for the resource, continue with “Configuring the Monitor Script” 
on page 428. 


Sample Xen_Template Unload Script 


The Xen_Template unload script appears similar to the following example: 
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#!/bin/bash 
/opt/novell/nes/lib/nesfunces 
export OCF _ROOT=/usr/lib/ocf/ 


#define domU name 
OCF_RESOURCE_INSTANCE=xen_vm_name 


#define shared volume name 
VOLUME _NAME=SOCF_ RESOURCE INSTANCE 


#define the volume group name 

CONTAINER NAME=name 

# define the device 
MOUNT_DEV=/dev/SCONTAINER_NAME/SVOLUME_NAME 


# filesystem settings 

export OCF RESKEY device=SMOUNT_DEV 

export OCF_RESKEY directory=/mnt/SOCF_ RESOURCE INSTANCE 
export OCF_RESKEY fstype=ext3 

#export OCF _RESKEY options= 


# service settings 
export OCF_RESKEY xmfile=SOCF_RESKEY directory/S$OCF_RESOURCE_ INSTANCE 


# stop the service 
exit_on_error ocf_stop Xen 


# umount the file system 
sleep 10 # if not using SMS for backup, please comment out this line 
exit_on_error ocf_stop Filesystem 


#deactivate the volume group 
exit_on_error vgchange -a n $VOLGROUP_ NAME 


# return status 
exit 0 
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Sample XenLive_Template Unload Script 
The XenLive_Template unload script appears similar to the following example: 


#!/bin/bash 

. /opt/novell/nes/lib/nesfuncs 
export OCF_ROOT=/usr/lib/ocf/ 

OCF RESOURCE INSTANCE=xen_vm_name 


# filesystem settings 
export OCF _RESKEY directory=/mnt/SOCF_RESOURCE_INSTANCE 


# service settings 
export OCF_RESKEY xmfile=SOCF_RESKEY directory/SOCF RESOURCE INSTANCE 
export OCF _RESKEY CRM meta_migrate_target=SNCS_ TOFROM 


RC=0 
# stop the service 
if [ -n "SNCS_TOFROM" ] 
then 
RC="ocf_migrate_to Xen” 
if [ SRC -ne 0 ] 
then 
ignore_error ocf_stop Xen 
fi 
else 
ignore _error ocf_stop Xen 
fi 


# return status 
exit $RC 


Configuring the Monitor Script 


The Xen_Template and XenLive Template each include a resource monitor script that you can 
customize. You use the script to monitor the health of a virtual machine cluster resource. 


Resource monitoring is disabled by default. If you want to enable resource monitoring for a virtual 
machine cluster resource, you must enable it prior to customizing the resource monitor script. 

+ “Enabling Resource Monitoring” on page 428 

¢ “Viewing or Modifying the Monitor Script” on page 429 

¢ “Sample Xen_Template Monitor Script” on page 430 

¢ “Sample XenLive_Template Monitor Script” on page 430 


Enabling Resource Monitoring 
To enable resource monitoring for a virtual machine cluster resource: 


1 In iManager, select Clusters > My Clusters. 
2 Select the cluster. 


3 On the Cluster Manager page, select the check box next to the virtual machine resource, then 
click the Details link. 


4 Click the Monitoring tab, then select the Enable Resource Monitoring check box to enable 
resource monitoring for the resource. 


Resource monitoring is disabled by default. 
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5 For the polling interval, specify how often you want the resource monitor script for this resource 
to run. 


You can choose to specify the number in minutes or seconds. 


6 Specify the number of failures (Maximum Local Failures) for the specified amount of time (Time 
Interval). 


If the resource monitor detects that the resource fails the number of times specified in the 
amount of time specified, a failure action initiates. 


7 Specify whether you want the resource to be set to a comatose state, to migrate to another 
server, or to reboot the hosting node (without synchronizing or unmounting the disks) if a failure 
action initiates. The reboot option is normally used only for a mission-critical cluster resource that 
must remain available. 


If the failure action initiates and you chose the option to migrate the resource to another server, 
the resource migrates to the next server in its Preferred Nodes list. The resource remains on the 
server it has migrated to unless you migrate it to another server or the failure action initiates 
again, in which case it again migrates to the next server in its Preferred Nodes list. 


If the failure action initiates and you chose the option to reboot the hosting node without 
synchronizing or unmounting the disks, each of the resources on the hosting node will fail over to 
the next server in its Preferred Nodes list because of the reboot. This is a hard reboot, not a 
graceful one. 


With resource monitoring, the Failover, Failback, and Start modes have no effect on where the 
resource migrates. This means that a resource that has been migrated by the resource 
monitoring failure action does not migrate back to the node it migrated from unless you manually 
migrate it back. 


Viewing or Modifying the Monitor Script 
To view or customize the monitor script for the virtual machine’s cluster resource: 


1 In iManager, select Clusters > My Clusters. 
2 Select the cluster. 


3 On the Cluster Manager page, select the check box next to the virtual machine resource that you 
created, then click the Details link. 


4 Click the Scripts tab, then click the Monitor Script link. 
5 View or edit the commands in the script that monitor the resource on the server. 
You can use the same commands that would be used at the Linux terminal console. 
See the following examples of the default Xen_Template and XenLive_Template monitor scripts: 
+ “Sample Xen_Template Monitor Script” on page 430 
¢ “Sample XenLive_Template Monitor Script” on page 430 
6 Specify the Monitor Script Timeout value, then click Apply to save the script. 


The timeout value determines how much time the script is given to complete. If the script does 
not complete within the specified time, the failure action initiates based on your settings in Step 7 
of “Enabling Resource Monitoring” on page 428. Cluster Services marks the monitor process as 
failed right after the defined timeout expires, but it must wait for the process to conclude before it 
can start other resource operations. 
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Sample Xen_Template Monitor Script 
The Xen_Template monitor script appears similar to the following example: 


#!/bin/bash 
/opt/novell/ncs/lib/nesfuncs 
export OCF _ROOT=/usr/lib/ocf/ 


#define domU name 
OCF_RESOURCE_INSTANCE=xen_vm_name 


#define shared volume name 
VOLUME _NAME=SOCF_RESOURCE_INSTANCE 


#define the volume group name 

CONTAINER NAME=name 

# define the device 
MOUNT_DEV=/dev/SCONTAINER_NAME/SVOLUME_ NAME 


# filesystem settings 

export OCF_RESKEY device=SMOUNT_DEV 

export OCF_RESKEY directory=/mnt/SOCF_ RESOURCE INSTANCE 
export OCF_RESKEY fstype=ext3 

#export OCF _RESKEY options= 


# service settings 
export OCF RESKEY xmfile=$OCF_RESKEY directory/SOCF RESOURCE_INSTANCE 


#check the logical volume 
exit_on_error status _lv SMOUNT_DEV 


# status of the file system 
exit_on_error ocf_ status Filesystem 


# status of the service 
exit_on_error ocf_status Xen 


# return status 
exit 0 


Sample XenLive_Template Monitor Script 
The XenLive_Template monitor script appears similar to the following example: 


#!/bin/bash 
/opt/novell/ncs/lib/nesfuncs 

export OCF _ROOT=/usr/lib/ocf/ 

OCF_RESOURCE_INSTANCE=xen_vm name 


# filesystem settings 
export OCF _RESKEY directory=/mnt/SOCF_ RESOURCE INSTANCE 


# service settings 
export OCF_RESKEY xmfile=SOCF_RESKEY directory/SOCF RESOURCE INSTANCE 


# status of the service 
exit_on_error ocf_status Xen 


# return status 
exit 0 
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Setting Up Live Migration 


Live migrations use the XenLive template. You can manually copy the virtual machine configuration 
files to the same path on each node of the cluster, or you can set up an OCFS2 file system for the 
configuration files. Do one of the following: 


¢ Manually copy the configuration file for the virtual machine to the same directory (the path must 
be the same) on each cluster node where the virtual machine will run. 


+ Configure the OCFS2 file system on a shared disk system and copy the virtual machine 
configuration file to a directory on the file system. You also must ensure that all cluster nodes 
where the virtual machine will run have access to the OCFS2 file system on the shared disk 
system. 


Ensure that your OCFS2 file system is working properly before you attempt to use it with Novell 
Cluster Services. 


An overview of OCFS2 is available in “Oracle Cluster File System 2” (http:/Awww.suse.com/ 
documentation/sle_ha/book_sleha/data/cha_ha_ocfs2.html) in the SUSE Linux Enterprise 
Server 11 SP3 High Availability Administration Guide (http://www.suse.com/documentation/ 
sle_ha/book_sleha/data/book_sleha.html). For detailed information about using OCFS2, see the 
OCFS2 Project (http://oss.oracle.com/projects/ocfs2/) on the Oracle website. 


For information about setting up live migration, see Configuring a Xen VM for Live Migration with a 
Cluster (http://www.novell.com/coolsolutions/feature/19676.html) in Novell Cool Solutions (http:// 
www.novell.com/communities/coolsolutions). 


Virtual Machines as Cluster Nodes 


In this scenario, you have OES 11x and Xen installed and configured on each node (physical 
machine). You create the OES virtual machine on each physical machine and install and configure 
Novell Cluster Services on each virtual machine. The combined virtual machines (cluster nodes) 
comprise one cluster. 


You can then create and configure cluster resources that run on the virtual cluster nodes. The 
process for creating and configuring cluster resources on a virtual cluster node is the same as ona 
physical cluster node. 


Cluster resources can be failed over or migrated between virtual cluster nodes that are on the same 
physical node or on separate physical nodes. 


Figure 15-2 depicts using virtual machines as cluster nodes. 
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Figure 15-2 Virtual Machines as Cluster Nodes 
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15.4 Virtual Cluster Nodes in Separate Clusters 


In this scenario, you have OES 11x and Xen installed and configured on each node (physical 
machine). You create multiple OES virtual machines on each physical machine and install and 
configure Novell Cluster Services on each virtual machine. During the Novell Cluster Services 
installation, you create separate clusters of virtual cluster nodes, with each virtual cluster node 
residing on a separate physical machine. This way you have multiple clusters of virtual cluster nodes 
on fewer physical machines. 


You can then create and configure cluster resources on each virtual cluster node and cluster. The 
process for creating and configuring cluster resources on a virtual cluster node is the same as ona 
physical cluster node. 


Figure 15-3 depicts using virtual cluster nodes in separate clusters. 
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Figure 15-3 Virtual Cluster Nodes in Separate Clusters 
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Mixed Physical and Virtual Node Clusters 


This is a temporary scenario that is used for upgrading cluster nodes or converting clusters from 
physical to virtual cluster nodes. 


This can be done through several different methods. One method is to add a virtual OES cluster node 
to an existing physical OES cluster. To do this, you install an OES 11x and Xen server (physical 
machine). You then create a OES virtual machine on the physical machine and install and configure 
Novell Cluster Services on the OES virtual machine. During the Novell Cluster Services installation, 
you add the OES virtual cluster node to your existing OES cluster (physical nodes). 


You can then migrate the desired resources from the physical cluster nodes to the virtual cluster 
node. This lets you offload resources from physical nodes so you can upgrade hardware and 
software and then replace the physical cluster nodes with virtual cluster nodes. 
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Figure 15-4 depicts how this setup might look. 


Figure 15-4 Mixed Physical and Virtual Node Cluster 
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Another method is to install Novell Cluster Services on physical nodes and create a separate cluster 
for each node. You then install an OES 11x with Xen server (physical machine) and create OES 
virtual machines and install Novell Cluster Services on each virtual machine. You can then add one 
virtual OES cluster node to each cluster to create multiple two-node clusters, each containing one 
physical and one virtual cluster node. 


This allows you to migrate the desired resources from each physical cluster node to the virtual cluster 
node in the same cluster. Using this setup, you offload resources from physical nodes so you can 


upgrade hardware and software and then replace the physical cluster nodes in each cluster with 
virtual cluster nodes. 
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Figure 15-5 depicts how this setup might look. 


Figure 15-5 Separate Mixed Physical and Virtual Node Clusters 


f 


@ES 
Host (Xen) 


OES Virtual [ie OES Virtual i OES Virtual 
Machine H : Machine it Machine 


NCS Cluster Node ! ! NCS Cluster Node ' ' NCS Cluster Node 
; E : ~ : 
e e e 
e. n 2 e. 
e e e 


NCS Cluster ! i NCS Cluster 4 ' j NCS Cluster g 
Node (Physical) : ' Node (Physical) á : ! Node (Physical) 


E P AAEE E E N A E E LELEA ALLAL E A a E a E E E TRENE TE 


Cluster 1 Cluster 2 Cluster 3 


Fibre Channel Switch Shared Disk 
System 


Additional Information 


To get started with virtualization, see “Introduction to Xen Virtualization” (http:/www.suse.com/ 
documentation/sles11/book_xen/data/cha_xen_basics.html) in the Virtualization with Xen (http:// 
www.suse.com/documentation/sles11/book_xen/data/book_xen.html) guide. 


For information on setting up virtualized NetWare, see “Installing, Upgrading, or Updating OES ona 
VM” in the OES 11 SP3: Installation Guide guide. 


For information on setting up virtualized OES servers, see “Installing, Upgrading, or Updating OES on 
a VM” in the OES 11 SP3: Installation Guide guide. 
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6 Troubleshooting Novell Cluster Services 


This section describes known issues and frequently asked questions for managing Novell Cluster 
Services. 


è Section 16.1, “Cluster Resource Is Not Accessible After a Network Service Restart,” on 
page 438 

¢ Section 16.2, “File Location Information,” on page 438 

¢ Section 16.3, “Version Issues,” on page 438 

¢ Section 16.4, “Diagnosing a Poison Pill Condition,” on page 439 

¢ Section 16.5, “Diagnosing Cluster Problems,” on page 439 

¢ Section 16.6, “Master IP Address Problem,” on page 440 

¢ Section 16.7, “Why didn’t my resource go to the node | specified?,” on page 440 

¢ Section 16.8, “iManager: Error 500 Occurs while Connecting to a Cluster,” on page 440 


¢ Section 16.9, “iManager: Error 500 Occurs after Installing or Updating the Clusters Plug-In for 
Novell iManager 2.7.5,” on page 441 


¢ Section 16.10, “iManager: Problems with Clusters Plug-In After Update for Novell iManager 
2.7.5,” on page 441 


¢ Section 16.11, “A Device Name Is Required to Create a Cluster Partition,” on page 441 


¢ Section 16.12, “Cluster Resource Goes Comatose Immediately After Migration or Failover,” on 
page 442 


¢ Section 16.13, “Cannot Authenticate to Remote Servers during Cluster Configuration,” on 
page 442 


¢ Section 16.14, “Cannot Connect to an iSCSI Target,” on page 442 
¢ Section 16.15, “Errors when Deleting a Cluster Resource or Clustered Pool,” on page 442 
¢ Section 16.16, “Is there a way to uninstall Novell Cluster Services from a server?,” on page 442 


¢ Section 16.17, “Running supportconfig Concurrently on Multiple Nodes Causes Cluster 
Problems,” on page 443 


¢ Section 16.18, “Error NFS Stale Handle Reported on Host when Cluster Failover Occurs,” on 
page 443 


¢ Section 16.19, “Error 20897 - This node is not a cluster member,” on page 443 
¢ Section 16.20, “Error 499 - Could not delete this resource Data_Server,” on page 444 


¢ Section 16.21, “Error 603 - smdr.novell is not registered with SLP for a new cluster resource,” on 
page 444 


¢ Section 16.22, “Migration Authentication Error Occurs when Connecting to a New Cluster 
Resource on the Target Server,” on page 444 


¢ Section 16.23, “Communications Errors,” on page 445 


¢ Section 16.24, “Renaming a Cluster Pool from an OES11SP3 Node is not Recommended in a 
Mixed Node Cluster Environment,” on page 446 
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16.1 Cluster Resource Is Not Accessible After a 
Network Service Restart 


If you restart the network services, cluster resource IP addresses will get removed from the network 
interfaces. As a result, the cluster resources will not be accessible through those IP addresses. 
Network service restart can happen as part of LAN settings reconfiguration through YaST or through 
the rcnetwork restart command. In order to recover from this state, follow the steps mentioned 
below: 


1 Run the cluster leave command to remove the node from the cluster. This will cause the 
cluster resources running on this node migrate to another node in the cluster. 


2 Runthe cluster join command to rejoin the node to the cluster. 


3 (Optional) You can also manually migrate the resources back to this node by running the 
cluster migrate command. 


16.2 File Location Information 


Information about Novell Cluster Services scripts and configuration can be found in the following 
locations. Ensure that you use the Clusters plug-in for iManager to configure cluster and resource 
settings and to edit the load, unload, and monitor scripts. You can view cluster events by using the 
Clusters plug-in for iManager. Go to Clusters > My Clusters, select the cluster, then click Event Log. 


Information File Location 


Load scripts /var/opt/novell/ncs 
Unload scripts 

Monitor scripts 

Cluster Services configuration files 


Load and unload script output files (.out) /var/opt/novell/log/ncs 


Most resource load and unload issues can be solved 
with the information in the .out files. 


Cluster Services scripts, such as Idncs and unldncs /opt/novell/ncs/bin 


Resource templates /opt/novell/ncs/templates 


16.3 Version Issues 


Knowing the location and purpose of the files that make up Novell Cluster Services can be useful in 
helping you troubleshoot problems and resolve version issues. See Appendix B, “Files for Novell 
Cluster Services,” on page 479. 
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16.4 Diagnosing a Poison Pill Condition 


A poison pill is given to a node if it stops sending out the Novell Cluster Services heartbeat packages, 
including the case when the node hangs or reboots. 


16.5 


To evaluate the poison pill condition on the node, look at the /var/log/messages log from the node 
that rebooted (was given the poison pill). Check the messages right before the restart. Normally, you 
can spot the process that caused the server to hang or reboot. 


You can run the cluster stats display command on the surviving master node to show when the 
Novell Cluster Services heartbeat packages stopped coming from the rebooted node. To be sure that 
is the case, you can also run a LAN trace to record the packages among the nodes. 


Other events that might cause a pause in sending out heartbeat packages include the following: 


¢ Antivirus software scanning the /admin file system 


+ 


+ 


Network traffic control (including the firewall) 


check_oesnss_vol.pl running under Nagios 


+ Packages that have been recently updated through the YaST Online Update or patch channels 


Diagnosing Cluster Problems 


To help Novell Technical Support diagnose your cluster problems, some or all of the following 
information might be requested: 


+ 


+ 


+ 


+ 


+ 


Cluster statistics. A report created by the cluster statistics gathering tool. 


Cluster configuration. An HTML report created by the Action > Run Report option on the 
Clusters > My Clusters page of the Clusters plug-in to iManager. 


SAN configuration: 
+ Host bus adapter, hub or switch type 
¢ Device driver name and revision 
¢ Storage controller type 
¢ Storage controller firmware revision 
SBD configuration - Single or mirrored partition? 
LAN configuration: 
+ Network interface card, hub, or switch type 
+ Device driver name and revision 
+ Dedicated heartbeat or shared public LAN? 
Server configuration: 
+ Type, memory, and number of CPUs 
¢ Software revisions and patches 
¢ List of RPMs 
+ /opt/novell/ncs/bin/1dncs file 
LAN packet trace 
Console log files 


Abend log files 
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16.7 


16.8 


¢ Server coredump files 
¢ Observable Coincidences? For example: 
+ Are poison pills experienced at the same time of day as scheduled maintenance activities? 


+ Are server inventory or health checks, virus scans, backups, or periodic eDirectory activity? 


Master IP Address Problem 


If the master IP address has a problem, such as a duplicate IP address on the network, the Clusters 
plug-in might not be able to connect to the master IP address to allow you to manage the cluster. The 
My Clusters page uses the IP address found in the Cluster object by default. If the master IP address 
does not respond, you cannot connect to the master IP address to manage the cluster in iManager. 


In OES 11 SP2 and later, you are prompted to use the server IP address of a specified node to 
manage the cluster while you fix the problem. See Section 8.12, “Viewing or Modifying the Cluster 
Master IP Address or Port,” on page 139. 


Why didn’t my resource go to the node | 
specified? 


In a failover situation, the cluster looks for the best solution for the node. It goes to the most preferred 
node if it can. If that node is not available, it attempts to go to the next node in the resource’s 
preferred nodes list. It considers if the node is available and if it has an Resource Mutual Exclusion 
rules that must be obeyed for resources that are already mounted on the target node. If all of the 
nodes in the resource’s preferred nodes list are not available or have RME conflicts, the resource 
goes comatose instead of failing over to one of the nodes in its preferred nodes list. 


In acluster migration situation, the resource is currently online and you specify a target node. The 
resource cannot go to the specified node if any of the following conditions exist, and it stays online on 
the original node. You can view the target node’s log to understand why the resource was not 
available. 


+ The specified node is not in the resource’s preferred nodes list. 


+ The specified node is in the resource’s preferred nodes list, but the node is currently running 
another resource that is a Resource Mutual Exclusion conflict for the resource you are 
attempting to migrate. 


+ The specified node is in the resource’s preferred nodes list, but the node is not available. 


iManager: Error 500 Occurs while Connecting toa 
Cluster 


Novell iManager might hang or time out while trying to connect to a server with the Cluster plug-in or 
the Storage plug-in. Error 500 is reported. This error can occur f your login user name for iManager is 
not a user that is enabled with Linux User Management (LUM) on the target server. 


To avoid this problem, ensure that the user name is LUM enabled on the target server. The Cluster 
plug-in connects to the master node in the cluster (that is, the node hosting the Master IP 
Resource). 
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16.9 


16.10 


16.11 


For more information, see Technical Information Document: iManager error 500 while trying to 
managing cluster, storage, user quotas, CIFS, or AFP (TID 7010295) (http://www.novell.com/support/ 
kb/doc.php?id=7010295) in the Novell Knowledgebase (http://www.novell.com/support/). 


iManager: Error 500 Occurs after Installing or 
Updating the Clusters Plug-In for Novell iManager 
2.7.5 


After installing or updating the Clusters plug-in to version 3.3.1 for Novell iManager 2.75, you get a 
Status Code 500 error whenever you attempt to manage the cluster from iManager. 


This problem can occur if iManager loads a version of the class loader file earlier than /var/opt/ 
novell /iManager/nps/WEB-INF/1ib/commons-lang-2.6.jar. Novell iManager uses one class 
loader for all of its plug-ins. If multiple versions of the class loader file exist in the /var/opt /novell1/ 
iManager/nps/WEB-INF/1ib directory, iManager loads whichever one comes first alphabetically. 


To resolve this problem, you must remove the earlier versions (Such as commons-lang. jar or 
commons-lang-2.4.jar) to ensure that iManager loads the 2.6 or later version of the class loader 
file, then restart Tomcat. 


For more information, see Section 5.7, “Installing or Updating the Clusters Plug-in for iManager,” on 
page 93. 


This problem has been resolved in the Cluster plug-in for iManager 2.7.6 and later. 


iManager: Problems with Clusters Plug-In After 
Update for Novell iManager 2.7.5 


The Clusters plug-in for Novell iManager 2.7.5 in OES 11 SP1 was reorganized to display two tasks in 
the left panel: My Clusters and My Resources. If you have problems displaying or using the plug-in 
after updating to this version, ensure that you performed the following tasks after the update: 


¢ Step 5 in Section 5.7.3, “Uninstalling and Reinstalling the Clusters Plug-In,” on page 94 


¢ Section 5.7.4, “Updating Role-Based Services for the Clusters Plug-In after Upgrading to OES 
11 SP1 or later,” on page 94 


A Device Name Is Required to Create a Cluster 
Partition 


If you are planning to work with shared-disk NSS pools and volumes, you must create a Split Brain 
Detector (SBD) partition when you configure the first node on the cluster by selecting the name of a 
device (such as sdc) that is already initialized and marked shareable for clustering. If you don't enter 
a device name, you must manually create an SBD before you configure clustering on a second node 
and before you attempt to create storage objects or cluster-enable NSS pools. 
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16.13 


16.14 


16.15 


16.16 


Cluster Resource Goes Comatose Immediately 
After Migration or Failover 


When the SLP daemon (s1pd) is not installed and running on a cluster node, any cluster resource 
that contains the ncpcon bind command goes comatose when it is migrated or failed over to the 
node because the bind cannot be executed without SLP. 


See “SLP” on page 56. 


Cannot Authenticate to Remote Servers during 
Cluster Configuration 


During the cluster installation and configuration, if you choose Remote System on the Novell Cluster 
Services LDAP Configuration page and you have LDAP configured to point to a NetWare 6.0 or 
earlier NetWare server, the cluster configuration fails. 


To work around this problem, you must edit the /etc/openldap/ldap.conf file. Either disable 
certificates (TLS _REQCERT <levels line) or change the file that contains the certificates (TLS_CACERT 
<filenames> line). See the ldap.conf man page for more information. 


Cannot Connect to an iSCSI Target 


If you are connecting to an iSCSI target that already has NSS partitions and pools created on it, you 
might not be able to access those NSS partitions and pools until you reboot the Linux initiator server. 
This is required for each Linux initiator server that will access the iSCSI target. 


For instructions on configuring an OES 11 or later server as an iSCSI initiator and connecting to an 
iSCSI target, go to “Mass Storage over IP Networks--iSCS]” (http://Awww.suse.com/documentation/ 
sles11/stor_admin/data/cha_inst_system_iscsi.html) in the SUSE Linux Enterprise Server 11 Storage 
Administration Guide. (http://www.suse.com/documentation/sles11/stor_admin/data/bookinfo.html) 


Errors when Deleting a Cluster Resource or 
Clustered Pool 
If you attempt to delete a cluster resource or clustered pool without first offlining the cluster resource, 


deletion errors occur, and the data associated with the clustered pool is not recoverable. 


To avoid this problem, offline the cluster resource before attempting to delete either the cluster 
resource or the clustered pool. For instructions, see Section 10.16, “Deleting Cluster Resources, or 
Disabling Clustering for a Pool, LVM Volume Group, or Service,” on page 228. 


Is there a way to uninstall Novell Cluster Services 
from a server? 


There is no utility to remove Novell Cluster Services and its related eDirectory objects. See 
Section 5.10, “Removing a Node from a Cluster,” on page 97. 
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16.18 


16.19 


Running supportconfig Concurrently on Multiple 
Nodes Causes Cluster Problems 


Running the supportconfig command concurrently on multiple nodes can cause the multiple nodes 
to lose communications with the others and go down. 


Novell Support provides the supportconfig package to customers in order to gather configuration, 
log, and error information from both the installation of the OS and from varying applications. The 
supportconfig command was designed without clustering considerations. The command is 
normally run after a server experiences problems. It is not a good idea to run the command 
concurrently on multiple nodes in a healthy cluster. If you need to run the supportconfig command 
on multiple nodes in a cluster, run it on one node at a time. 


Error NFS Stale Handle Reported on Host when 
Cluster Failover Occurs 


The host I/O reports an NFS Stale Handle error immediately after failover is performed on the 
cluster. 


This problem can occur if a user attempts to access the IP address of the resource before the volume 
is mounted or after the volume is dismounted. You can modify the order of commands in a load script 
to: NSS, NFS, IP, NCP, [AFP], and [CIFS | Samba]. Reverse the order in an unload script. This allows 
storage to be mounted before the IP address is bound, and to be dismounted after the IP address is 
unbound. Adjust your scripts to this order, then take the resource offline and bring it online to apply 
the changes. For sample scripts, see Section 12.10, “Adding NFS Export for a Clustered Pool 
Resource,” on page 266. 


Error 20897 - This node is not a cluster member 


If Novell Cluster Services is installed on a node, but an SBD does not exist, NSS tools (including 
Novell Linux Volume Manager (NLVM) commands, NSSMU, NSS console commands, and the 
Storage plug-in for Novell iManager) return the following error: 


Error 20897 - This node is not a cluster member. 


In a Novell Cluster Services cluster, NSS tools use the cluster’s SBD to detect if a node is a cluster 
member and to lock against concurrent changes to physically shared storage. Without an SBD, 
NLVM cannot detect whether a node is a member of the cluster and cannot acquire the locks it needs 
to execute tasks. In this state, you can use the -s option with NLVM commands to prepare a device 
and create an SBD partition. To minimize the risk of corruption, you must ensure that nobody else is 
changing any storage on any nodes at the same time. 


For information about creating an SBD partition, see Section 9.18, “Creating or Deleting Cluster SBD 
Partitions,” on page 173. 
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16.21 


16.22 


Error 499 - Could not delete this resource 
Data_Server 

When you try to delete a cluster resource, you get a message “Could Not Delete This Resource 
Data_Server (Error 499). The error means that the object does not exist in eDirectory. This error can 


occur if you try to delete an orphaned cluster resource. An orphaned cluster resource does not have 
a pool or volume associated with it, does not have an IP address, and the scripts are empty. 


To delete an orphaned cluster resource: 


1 On the master node of the cluster, open a terminal as the root user. At the command prompt, 
enter the following commands: 


/opt/novell/nes/bin/nes-configd.py -init 
and if the resource is still there, 


echo -n "exec rm -f /var/opt/novell/ncs/data_server.*" > /proc/ncs/cluster 


Error 603 - smdr.novell is not registered with SLP 
for a new cluster resource 


You might get an error after you create a cluster resource, indicating that smdr.novell is not 
registered with SLP for cluster resources, but the smdr .nove11 service for the node is registered. 


Error: "Ccluster--<212>: Read ResVol error -603" 


The first time a cluster resource is created, smdrd cannot figure it out. The smdrd service is designed 
to work with resources that contain a data volume. 


Ensure that the resource contains a volume and is configured properly, then restart smdrd. 
Thereafter, smdrd is aware of the cluster resource, and advertises it correctly. 


1 Log in to the server as the root user, open a terminal console, then enter 


renovell-smdrd restart 


Migration Authentication Error Occurs when 
Connecting to a New Cluster Resource on the 
Target Server 


You might get a Migration Authentication error when you attempt to connect to a newly created 
cluster resource on the target server. 


2013-05-03 12:34:20,095 INFO - Migration Framework:Authentication:nbackup: 
Unable to retrieve the Target Service Name list from <resource_IP address>, trying 
with DNS name <resource_DNS_name> 

2013-05-03 12:34:20,096 INFO - Migration Framework:Authentication: 

2013-05-03 12:34:20,096 INFO - Migration Framework:Authentication:nbackup: 
Unable to retrieve the Target Service Name list from <resource_DNS_name> 


There are two possible causes: 


+ The Storage Management Service (SMS) smdr.novell service running on the target server is 
not aware of the newly created resource. 
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The Migration tool uses SMS to transfer data between nodes. When a cluster resource is first 
created, the smdrd service is not automatically aware of the new resource. See Section 16.21, 
“Error 603 - smdr.novell is not registered with SLP for a new cluster resource,” on page 444. 
Restart smdrd. Thereafter, smdrd is aware of the cluster resource, and advertises it correctly. 


1. Log in to the target server as the root user, open a terminal console, then enter 
rcnovell-smdrd restart 


+ The cluster resource does not contain a volume. 


A properly created pool cluster resource or LVM cluster resource contains at least one volume. 
Even if you have restarted the smdrd service, the service by design does not recognize a 
resource unless it contains a data volume. 


Ensure that the resource contains a volume and is configured properly, then restart smdrd. 
Thereafter, smdrd is aware of the cluster resource, and advertises it correctly. 


1. Create a volume on the pool or LVM volume group, update the resource scripts as needed, 
then take the resource offline and bring it online to apply the changes. 


2. Log in to the target server as the root user, open a terminal console, then enter 


renovell-smdrd restart 


16.23 Communications Errors 


When you manage a cluster or cluster resources with the Clusters plug-in for iManager, CIMOM 
errors can occur for the following reasons: 


+ The CIMOM broker daemon must be running and listening on port 5989. See theSection 4.6.8, 
“SFCB and CIMOM,” on page 59. 


+ You must be able to connect to the cluster master node. Verify the ability to connect to the cluster 
master node by pinging the cluster IP address from a terminal console on a different computer. 


If there is a conflict for the master IP address, you can modify the master IP address only by 
using the Clusters plug-in for iManager as described in Section 8.12, “Viewing or Modifying the 
Cluster Master IP Address or Port,” on page 139. After you fixed the conflicting IP address 
problem, you must close the browser and restart the cluster, and then open a browser and log in 
to Novell iManager again in order to continue to manage the cluster. 


+ The cluster IP address must be the same in the NCS:Network Address attribute and Network 
Address attribute for the Cluster object. Addresses might not match if you modified the master IP 
address for the cluster and did not restart the cluster. 


Other possible issues are described in the Cluster Communications Error message (see Figure 16-1). 
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Figure 16-1 Cluster Communications Error 
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Renaming a Cluster Pool from an OES11SP3 Node 
is not Recommended in a Mixed Node Cluster 
Environment 


In a mixed node cluster environment where OES 2015 nodes exist, do not rename a cluster pool 
using an OES 11 SP3 node. If you do so, the resource will go to unassigned state while migrating it to 
other nodes. 


As a workaround, rename a cluster pool only from an OES 2015 node that has been patched with 
January 2016 patches or above. 
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17.1 


17.2 


Security Considerations 


This section describes security issues and recommendations for Novell Cluster Services for Novell 
Open Enterprise Server (OES) 11 SP3. It is intended for security administrators or anyone who is 
responsible for the security of the system. It requires a basic understanding of Novell Cluster 
Services. It also requires the organizational authorization and the administrative rights to effect the 
configuration recommendations. 

¢ Section 17.1, “Cluster Administration Rights,” on page 447 

¢ Section 17.2, “Ports,” on page 447 

¢ Section 17.3, “Email Alerts,” on page 448 

¢ Section 17.4, “Log Files,” on page 448 


¢ Section 17.5, “Configuration Files,” on page 448 


Cluster Administration Rights 


For information about the rights needed to install and manage Novell Cluster Services, see the 
following sections: 

+ “NetIQ eDirectory 8.8 SP8” on page 52 

+ “Novell Domain Services for Windows” on page 64 

+ “SFCB and CIMOM” on page 59 

+ “SLP” on page 56 

+ “eDirectory Tree” on page 53 

+ “Cluster Installation Administrator” on page 47 


¢ “Cluster Administrator or Administrator-Equivalent User” on page 50 


Ports 


For each cluster, you can specify the port used for cluster communication. The default cluster port 
number is 7023, and is automatically assigned when the cluster is created. You might need to modify 
this value if there is a port conflict. See Section 8.12, “Viewing or Modifying the Cluster Master IP 
Address or Port,” on page 139. 


If you enable Email Notification, Cluster Services uses Postfix to send messages. The default port 
number is 25. For information about how to address port conflicts, see Section 8.6.1, “Configuring an 
Email Port,” on page 127. 


You must specify the eDirectory port when you install clusters. Port 636 is the default port number for 
eDirectory communications in the tree. 


If you are using a firewall, the port must be opened for CIMOM communications between the cluster 
and Novell iManager. Port 5989 is the default setting for secure HTTP (HTTPS) communications. 
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17.4 


17.5 


Email Alerts 


You can enable or disable email notification for the cluster and specify up to eight administrator email 
addresses for cluster notification. 


Novell Cluster Services uses Postfix to send email alerts. If you have a cluster resource that uses 
SMTP, that resource might not work in the cluster unless you change the Postfix configuration. See 
Section 8.6, “Configuring Cluster Event Email Notification,” on page 127. 


Log Files 


NCS normally writes log messages to /var/log/messages. 
NCS installation writes log messages to /var/opt/novell/install/ncslog. 
NCS configuration writes log messages to /var/log/YaST2/y21log. 


You can view cluster events logged in the /admin/Novell/Cluster/EventLog.xml file by using the 
Clusters plug-in for iManager. Go to Clusters > My Clusters, select the cluster, then click Event Log. 
See Section 9.6, “Viewing the Cluster Event Log in iManager,” on page 161. 


You can also copy the /admin/Novell/Cluster/EventLog.xm1 file to a working location, and then 
use the cat command to display the file. See Section 9.7, “Viewing the Cluster Event Log at the 
Command Line,” on page 163. 


NCS writes cluster resource runtime messages to files under /var/opt /novell/log/ncs/. Output 
log files are named with the resource name, the type of script (load, unload, or monitor), and the . out 
extension (<resource name>.<load|unload|monitor>.out). For example: /var/opt/novell/ 
log/nes/myresource.unload.out reports the log for the myresource unload script messages. 


In OES 11 SP2 and later, you can print summaries of failed or incomplete events in the * . out log files 
by copying the file to a working location and using the DotOutParser utility. See Section A.5, 
“DotOutParser Utility,” on page 459. 


Configuration Files 


You should never modify configuration files directly, unless you are directed to do so bya 
documented procedure or Novell Support. 


The cluster configuration file is /etc/opt/novell/nes/clstrlib.conf. 
The cluster configuration for a specific node is /etc/opt /novell/ncs/<nodename>. 
The cluster node numbers are found in the /var/opt/novell/nces/gipc.conf file. 


The Novell Cluster Services reboot behavior after shutting down a node conforms to the kernel panic 
setting for the Linux operating system. By default the kernel panic setting is set for no reboot after a 
node shutdown. You can use directive kernel .panic in the /etc/sysct1.conf file to allow an 
automatic reboot and to specify the number of seconds to delay the reboot. See Section 8.9, 
“Configuring the Cluster Node Reboot Behavior,” on page 135. 


If you use Device Mapper Multipath for devices, ensure that you modify the settings in the /etc/ 
modprobe.conf.local file and the /etc/multipath.conf file, so that multipath I/O works correctly 
for Novell Cluster Services cluster resource fail over and fail back. See Section 4.10, “Multipath |/O 
Configuration Requirements,” on page 68. 
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A.1 


Console Commands for Novell 
Cluster Services 


Novell Cluster Services provides several console commands to help you perform certain cluster- 
related tasks. 

¢ Section A.1, “Cluster Management Commands,” on page 449 

¢ Section A.2, “Business Continuity Clustering Commands,” on page 455 

¢ Section A.3, “OES Installation extend_schema Command,” on page 455 

¢ Section A.4, “SBD Utility,” on page 456 

¢ Section A.5, “DotOutParser Utility,” on page 459 

¢ Section A.6, “CSMPORT Utility (Cluster Segment Manager Import/Export),” on page 460 

¢ Section A.7, “ncs-configd.py Script (Pushing Configuration Updates to All Nodes),” on page 467 


¢ Section A.8, “ncs_install.py Script (Extending the Schema, Monitoring NDSD, or Removing NCS 
Configuration),” on page 468 


¢ Section A.9, “ncs_ncpserv.py Script (Creating an NCP Virtual Server Object for a Clustered LVM 
Volume Group),” on page 472 


¢ Section A.10, “ncs_resource_scripts.pl Script (Modifying Resource Scripts Outside of 
iManager),” on page 474 


¢ Section A.11, “NCPCON Mount Command for NCP and NSS Volumes,” on page 476 


Cluster Management Commands 


To execute a cluster console command, enter cluster followed by the command. For example, if you 
want to display cluster statistics, enter cluster stats display atthe terminal console. You can also 
enter cluster help at the command prompt to get information on the commands and their functions. 


The functions of many of the commands can also be performed using iManager. See the other 
sections of this document for additional information. 


Table A-1 lists the cluster-related terminal console commands and gives a brief description of each 
command. 
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Table A-1 Cluster Console Commands 


Cluster Console Command 


ALERT {resource} {YES|NoO} 


Description 


The resource start, failover, or failback mode is set to manual and the resource 
is waiting for administrator intervention to start on a node, or to fail over or fail 
back to another node. Alert types are Start Alert, Failback Alert, and Failover 
Alert. 


For the Start Alert, you must address the alert, then offline and online the 
resource. 


Specify the resource name in the command and use the YES or NO switch to 
accept or reject an alert on a resource to control fail over, fail back, or manual 
start. 


Example 


cluster alert resl yes 


CONVERT preview 
[resource] 


CONVERT preview 


CONVERT commit 


Finalizes the cluster conversion from NetWare to Linux after all nodes ina 
mixed cluster have been converted to Linux. The CLUSTER CONVERT command 
can be executed only on Linux cluster nodes. 


Specify a resource name with the Preview option to view the resource load and 
unload script changes prior to finalizing the conversion. If you do not provide a 
resource name, it displays the information for all resources. 


Use the Commit switch without specifying a resource to finalize the conversion 
for all cluster resources. 


Examples 
cluster convert preview resl 


cluster convert preview 
cluster convert commit 


DOWN 


Removes all cluster nodes from the cluster. This command has the same effect 
as executing the CLUSTER LEAVE command on every server in the cluster. 


You are prompted to confirm the cluster down. 
Example 


cluster down 


EXEC "path_to_ script" 


Executes the specified script on all nodes in the cluster. 
Example 


cluster exec "command" 
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Cluster Console Command Description 


INFO {All, Basic, Displays information on cluster configuration. 
Notification, Priority, 
Protocol, Summary} Options 

all 


Displays a combination of Basic, Notification, Priority, and Protocol information. 
basic 

Displays IP address, port, and cluster quorum settings. 
notification 

Displays cluster e-mail notification settings. 

priority 

Displays the resource priority list. 

protocol 

Displays the cluster protocol settings. 

summary 

Displays the cluster protocol summary. 

Example 


cluster info protocol 


JOIN Adds the node where the command is executed to the cluster and makes the 
node visible to other servers in the cluster. Novell Cluster Services software 
must already be installed and running on a node for it to join the cluster. 


Example 


cluster join 


LEAVE Removes the node where the command is executed from the cluster. The node 
will not be visible to other servers in the cluster. 


Example 


cluster leave 


MAINTENANCE {ON|OFF} Turning this switch on lets you temporarily suspend the cluster heartbeat while 
hardware maintenance is being performed. This is useful if you want to reset or 
power down the LAN switch without bringing the cluster servers down. 


Turning this switch on from one cluster server puts the entire cluster in 
maintenance mode. 


Running the command without the {ON|OFF} parameter reports the 
maintenance status of the cluster (that is, whether maintenance mode is on or 


off). 
Examples 


cluster maintenance on 
cluster maintenance 
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Cluster Console Command Description 


MIGRATE {resource} { Migrates the specified resource from the node where it is currently running to 

<node_name> | -list | - the node that you specify in the command. The node that you specify must be 

most | -next } running in the cluster and also be in the resource’s Preferred Nodes list. 
Options 


<node name> 


Migrates the resource to the specified node if possible. No action is taken if the 
specified node is not in the resource’s preferred nodes list, there is a Resource 
Mutual Exclusion conflict on the specified node, or the specified node is not 
currently active in the cluster. 


-1l1, -list 
Shows the preferred nodes list for the specified resource. 
-m, -most 


Migrates the specified resource to the most preferred node currently in the 
cluster. If the resource is running on such a node, no action is taken. 


-n, -next 


Migrates the resource to the node in the preferred node list that is next in order 
to the node where the resource is currently running. If there is no next node or 
all such nodes are not in the cluster currently, it searches from the beginning of 
the resource’s preferred nodes list. No action is taken if a new destination 
could not be determined after the search is exhausted. 


Examples 


Move res1 from the current node to node2 in the resource’s preferred nodes 
list. The resource is migrated only if there are no Resource Mutual Exclusion 
conflicts on the target node. 


cluster migrate resl node2 
List the preferred nodes for resource POOL_14 SERVER. 
cluster migrate POOL 14 SERVER -1 


Preferred nodes for resource 'POOL_14 SERVER' 
CG-06 
CG-05 
CG-04 
CG-03 
CG-02 
CG-01 
CG-08 
CG-07 


Status for Resource: POOL 14 SERVER 


Running on CG-05 Lives: 65 
Revision: 5 
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Cluster Console Command Description 


MONITOR {resource} <start Manually starts, stops, or checks the status of resource monitoring. The 

| stop | status> resource must be running on the node where you issue the command. 
Resource monitoring must be enabled for the resource in order to use this 
command. 


Example 


cluster monitor sh_pool_res_01 status 


OFFLINE {resource} Unloads the specified resource from the node where it is currently running. 
Example 


cluster offline resl 


ONLINE {resource} {node Starts the specified resource on the most preferred node that is currently 

name } active. You can start the resource on a different node by specifying that node in 
the command. The node that you specify must be running in the cluster and 
also be in the resource’s Preferred Nodes list. 


Example 


cluster online resl 
cluster online resl nodel 


POOLS Lists the NSS pools on the shared disk system that are accessible by Novell 
Cluster Services. 


Example 


cluster pools 


RENAME Renames a pool cluster resource. This command must be issued from the 
<old_resource_name> master node. The resource must be in offline state to be renamed. The new 
<new_resource_name> name must not exist prior to the renaming. 


Renaming the resource does not modify the resource’s virtual server name 
(NCS:NCP Server object). You can delete and re-create the NCS:NCS Server 
object with a new name by using iManager. 


Example 


cluster rename POOL1 SERVER custom_name22 


RESOURCES Lists all resources that currently exist in the cluster. The resources do not need 
to be online or running. 


Example 


cluster resources 


RESTART [seconds] Restarts Novell Cluster Services software on all servers in the cluster. The 
cluster leave process begins immediately. Specify a value of 60 or more 
seconds as the time to wait before the cluster join begins. 


The default setting is 60 seconds. The default setting is used if a value is not 
provided, if the value provided is smaller than 60 seconds, or if the input is 
invalid. 


You are prompted to confirm the cluster restart. 
Example 


cluster restart 60 
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Cluster Console Command Description 


SCAN FOR NEW DEVICES IMPORTANT: This command is deprecated on Linux. 


You can use the nlvm rescan command on OES 11 and later. 


You can alternatively use the rescan-scsi-bus.sh script to scan for the new 
devices on Linux without rebooting. See “Scanning for New Devices without 
Rebooting” (http://www.suse.com/documentation/sles11/stor_admin/data/ 
scandev.html) in the SUSE Linux Enterprise Server 11 Storage Administration 
Guide (http://www.suse.com/documentation/sles11/stor_admin/data/ 
bookinfo.html). 


WARNING: In EMC PowerPath environments, do not use the rescan-scsi- 
bus. sh utility provided with the operating system or the HBA vendor scripts for 
scanning the SCSI buses. To avoid potential file system corruption, EMC 
requires that you follow the procedure provided in the vendor documentation 
for EMC PowerPath for Linux. 


SET {Parameter} {Value} Sets cluster parameters individually for the cluster. See Chapter 8, 
“ Configuring Cluster Policies, Protocols, and Properties,” on page 113 for 
more information on cluster parameters. 


Specify one of the following parameters and a value for that parameter: 


IPADDRESS sets the cluster master IP address to the specified value. If you 
change the cluster IP address, you must restart cluster software on all 
cluster nodes. 

PORT sets, or lets you change, the IP port number of the cluster master. 

QUORUMWAIT sets the amount of time in seconds that the cluster waits before 

resources start to load. 

UORUM sets the number of nodes that must be running in the cluster before 

resources will start to load. 

HEARTBEAT sets the amount of time in seconds between transmits for all nodes 
in the cluster except the master. 

TOLERANCE sets the amount of time in seconds that the master node gives all 
other nodes in the cluster to signal that they are alive. 

MASTERWATCHDOG sets the amount of time in seconds between transmits for the 
master node in the cluster. 

SLAVEWATCHDOG sets the amount of time in seconds that the slave nodes give 
the master node in the cluster to signal that it is alive. 

MAXRETRANSMITS sets the maximum number of times transmits will be 

attempted between the master node and slave nodes. 

ENABLEEMAIL enables and disables email notification. You can set the value to 

OFF to disable email notification, or either CRITICAL or VERBOSE to 

enable email notification. 

EMAILADDRESSES lets you specify the email addresses used for email 
notification. The addresses should be separated by spaces. Using this 
parameter without specifying any addresses clears existing addresses that 
have been set previously. 

EMAILOPTIONS sets the email notification options. Specify XML as the value to 

receive email notification in XML format. Not specifying any value with this 

parameter turns notification in XML format off. 

RESOURCEPRIORITY sets the resource priority for the cluster. 


10 


Example 


cluster set ipaddress 10.1.1.1 
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A.3 


Cluster Console Command Description 


STATS {Display, Clear} The Display parameter reports the node number, node name, and heartbeat 
information to the console screen. 


The Clear parameter resets the various stats counters. This command is useful 
for troubleshooting network problems related to the cluster heartbeat protocol. 


Example 


cluster stats display 


STATUS {resource} Reports the status of the specified resource. This includes the number of times 
the resource has been migrated or failed over to another server, the resource 
state, and the node where the resource is currently running. 


Example 
cluster status resl 


VIEW Displays the node name, cluster epoch number, master node name, and a list 
of nodes that are currently members of the cluster. 


Example 


cluster view 


Business Continuity Clustering Commands 


If Novell Business Continuity Clustering (BCC) is installed and running on the cluster, you can use the 
following additional cluster commands to manage the BCC cluster environment. 


connections 
credentials 
disable 
enable 

nsmi 


reset resources 


For information about using these commands, see “Console Commands for BCC” (http:// 
www.novell.com/documentation/bcc/bcc12_admin_lx/data/bcccommands.html) in the BCC 1.2: 
Administration Guide for Linux (http://www.novell.com/documentation/bcc/bcc12_admin_lIx/data/ 
bookinfo.html). 


OES Installation extend schema Command 


A tree administrator user with credentials to do so can use the OES Installation extend_schema 
command to extend the eDirectory schema before a cluster is installed anywhere in a tree. This 
allows container administrators (or non-administrator users) to install a cluster in a container in that 
same tree without needing full administrator rights for the tree. You need to extend the schema only 
one time in the tree where you will be installing clusters. 

¢ Section A.3.1, “Syntax,” on page 456 

è Section A.3.2, “Options,” on page 456 


¢ Section A.3.3, “Example,” on page 456 
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A.3.1 


A.3.2 


A.3.3 


A.4 


Syntax 


/opt/novell/oes-install/util/extend_schema --port <port_num> <admin_username> <admin_password> 
<ldap_server_ip address> <schema_file> 


To extend the schema, the tree administrator user modifies the following schema files in the given 
order: 


/opt/novell/ncs/schema/nces.1ldif 


/opt/novell/nces/schema/ncepserver.preldif 


Options 


Replace the parameters with the credentials to access and location of the eDirectory schema files. 


Parameter Description Example 


port_num The port number you assigned for eDirectory 636 
communications in the tree where you plan to install 
clusters. The default port is 636. 


admin_username The typeful fully distinguished user name of the cn=admin, o=example 
administrator who has the eDirectory rights needed 
to extend the schema. 


admin_password The password of the administrator user. pas5word 


Idap_server_ip_address The IP address of the eDirectory server that 10.10.10.1 
contains the schema files. 


Example 


For example, enter the following commands in the order shown, using the values for your particular 
solution: 


/opt/novell/oes-install/util/extend_schema --port 636 cn=admin,o=example pas5WOrd 
10.1.1.1 /opt/novell/ncs/schema/ncs.1ldif 


/opt/novell/oes-install/util/extend_schema --port 636 cn=admin,o=example pas5WOrd 
10.1.1.1 /opt/novell/ncs/schema/ncpserver.preldif 


SBD Utility 


The SBD utility (sbdutil) allows you to create, find, or view a Novell Cluster Services SBD partition. 


IMPORTANT: The cluster SBD partition is not required unless you have shared storage in the cluster. 


We recommend that you carve out a LUN/disk of 20 MB in size to use for the SBD. If you mirror the 
SBD, you need to carve out a separate LUN/disk of equal size to use. Before you begin, each of 
these small disks must be initialized and marked as shareable for clustering. You can initialize the 
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device by using the Novell Storage Services (NSS) Management Utility (nssmu (8) ) or the Storage 
plug-in to iManager. The NSS utility called ncsinit (8) is available for initializing a device and setting 
it to a shared state. 

¢ Section A.4.1, “Syntax,” on page 457 

¢ Section A.4.2, “Options,” on page 457 

¢ Section A.4.3, “Return Value,” on page 458 

¢ Section A.4.4, “Examples,” on page 458 


A.4.1 Syntax 


sbdutil [-c|-f|-i]-v] [-s] [-d device] [-d device] [-p partition] [-n cluster_name] 
sbdutil -c -d device [-s [size]] [-n cluster_name] 

sbdutil -f [-s] [-n cluster _ name] 

sbdutil -i -p partition [-s] [-n cluster_name] 

sbdutil -v [-p partition] [-s] [-n cluster name] 


Log in to a node in the cluster where you want to create the SBD partition, then enter the command at 
a terminal console as the root user or any other user in admin or ncsgroup. If the command 
succeeds, the partition name is printed. See Section A.4.3, “Return Value,” on page 458 for more 
information. 


A.4.2 Options 


-C 


Create an SBD partition. This option requires at least one device to be specified. You can create 
a mirrored SBD by supplying more than one device with multiple instances of the -d option. 


IMPORTANT: Do not create an SBD partition for a cluster that already has an SBD partition. If 
you need to re-create the SBD for a cluster, delete its existing SBD first. 
To delete an SBD: 
1. Enter cluster down at the server console of one cluster server. 
This causes all cluster servers to leave the cluster. 
2. Delete the SBD partition. 
You can use nssmu or other utilities to delete the SBD partition. 


Find the SBD partition. 


Initialize the SBD partition. If there is information in the sbdutil -v view from old nodes that 
have been removed from the cluster, you can run sbdutil -i to initialize the view. This can be 
done without any issues while the cluster is running. 


View the SBD partition. 
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A.4.3 


A.4.4 


-d <device> 
The device where you want to create an SBD partition. You can create a mirrored SBD by 
supplying more than one device with multiple instances of the -d option. Specify only the base 
(leaf) names (such as sdb or mpathd) with the -d option. 

-p <partition> 


Use this partition instead of searching for one. 


-n <cluster_ name> 


Use the specified cluster name instead of getting the name from cluster.xml. If this option is 
not specified, the SBD partition is named by default with the cluster name that is found in the 
cluster .xml file on the node. 


Assume the device is a shared disk system instead of checking cluster.xml. An optional 
partition size (in MB) can also be specified when creating a partition (-c). The default size is 8 
MB. Some of the allocated space is used for storing metadata such as the partition table and 
MBR (master boot record) for the partition. 


Specify the size as -1 to use all free space on the device. This option allows Novell Cluster 
Services to use a whole disk/LUN (or LUNs) that you set aside for SBD. 


Return Value 


If the command succeeds, it prints the partition name to the screen and returns "0". Otherwise, no 
partition name is printed out, and a non-zero error code is returned. 


You can use "echo $?" at the end of the command to check the return code: 


/opt/novell/nes/bin/sbdutil -c -n <cluster name> -d <device> -d <device> -s <size>; 
echo $? 


Examples 


The following example demonstrates a successful command where the mycluster1.sbd partition is 
created: 


/opt/novell/ncs/bin/sbdutil -c -n myclusterl -d MD_EMC_001G_A -d MD_EMC_001G B -s - 
1; echo $? 

/dev/nss/mycluster1.sbd 

0 


The following example demonstrates a failed command where no partition is created, and a non-zero 
error code is returned: 


/opt/novell/nes/bin/sbdutil -c -n myclusterl -d MD_EMC_001G_ A -d MD EMC_001G B -s 
2048; echo $? 


2 


Examples 


This program normally runs as root on a node in the cluster that will be using the SBD. 


sbdutil -f 


This tells you whether an SBD partition exists and identifies the device on the SAN where the 
SBD partition is located. 
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A.5.1 


A.5.2 


sbdutil -c -n mycluster1 -d sdb -s -1 


Creates an SBD partition for the cluster named mycluster1 on the LUN /dev/sdb. The size 
isset to use all of the free space on the device. 


sbdutil -c -n mycluster1 -d sdb -d sdc 


Creates a mirrored SBD partition for the cluster named mycluster1 on the LUN /dev/sdb with 
the mirror on /dev/sdc. 


DotOutParser Utility 


The DotOutParser utility (/opt /novell/nes/bin/dotoutparser.p1) prints summaries of failed or 
incomplete events that have been recorded in a specified /var/opt /novell/log/ncs/ 

<resource name>.<script>.out log file. It also prints output (if any) from any commands that failed 
or got stuck. You can include ignored errors if desired. Line numbers allow you to easily refer the 
summary output to the source lines in the *. out file. You can omit the line numbers if desired. 


The verbosity level controls the amount of information printed to the summary. The higher the level of 
verbosity you specify, the more information you get in the summary output. 


¢ Section A.5.1, “Syntax,” on page 459 
¢ Section A.5.2, “Options,” on page 459 
¢ Section A.5.3, “Example,” on page 460 


Syntax 


At the command prompt on the cluster node, enter the following command as the root user: 
/opt/novell/ncs/bin/dotoutparser.pl [-a] [-n] [-i] [-v|-vv|-vvv|-vvvv] <file_name|-> 


You can copy the /var/opt/novell/log/nes/ <resource_name>.<script>.out log file of interest 
to a working location, then execute the command on the copy. 


Options 
-?, -h, --help 
Print usage and exit. 
file_name|- 
(Mandatory) Specify the *.out log file to be parsed, or specify - (hyphen) for standard input. 


/var/opt/novell/log/ncs/<resource_name>.<script>.out 
-a 

(Optional) Print all records in the specified file. 
-n 

(Optional) Do not add line numbers to the summary output. 
-i 


(Optional) Print ignored errors in addition to the failed or incomplete events. 
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-V, -VV, -VVV, -VVVV 


(Optional) Specify the verbose level (1 to 4). The higher the level of verbosity you specify, the 
more information you get in the summary output. 


-V 


(Default) Print the entries with plus (+) variable assignments. 


Print the -v level entries and entries starting with ++ (sub-command). 
-VVV 

Print the -vv level entries and entries starting with +++ (more sub-command). 
-VVVV 


Print all entries in the specified file. 


A.5.3 Example 


/opt/novell/ncs/bin/dotoutparser.pl /usr/src/temp/POOL_09_SERVER.load.out 


Fri May 3 11:51:59 2013 (#1): 
2: + exit_on error nss /poolact=POOL_09 
9: + return 0 


0: + exit_on_error ncpcon mount VOL 092=237 
25: + return 0 
26: + exit_on_error ncpcon mount VOL_091=238 
41: + return 0 
42: + exit_on_error add_secondary_ipaddress 192.168.1.9 
94: + return 0 
95: + exit_on_error ncpcon bind --ncpservername=CLUSTER1_ POOL _09 SERVER --ipaddress=192.168.1.9 
97: ++ ncpcon bind --ncpservername=CLUSTER1 POOL _09 SERVER --ipaddress=192.168.1.9 
98: ... Executing " bind" 
995 
100: Cannot bind server, failure reason = -632 
101 
102: ... FAILED completion [elapsed time = 20 Seconds 2 msecs 671 usecs] 


107: + exit 1 


A.6 CSMPORT Utility (Cluster Segment Manager 
Import/Export) 


The Novell Cluster Services Cluster Segment Manager (CSM) Import/Export utility allows you to use 
a Linux POSIX volume that was cluster-enabled with a CSM container. This conversion is required 
because the Enterprise Volume Segment Manager (EVMS) was deprecated on SUSE Linux 
Enterprise Server 11, and the CSM is no longer available on OES 11 and later servers. 


The utility can be used to scan for CSM containers and check if they can be imported for use in the 
cluster. This is the default mode when you run it without any options, or with only the -v option. By 
default, the utility searches block devices (/dev/sd*) for containers. Information about each device is 
displayed. Details about the CSM container are present if the container exists and can be imported for 
use in the cluster. 


The utility also allows you to do the following: 


¢ Search for a specified CSM container and check if it can be imported for use in the cluster. 


+ Import a specified CSM container for exclusive use in the cluster, and generate a corresponding 
Device Mapper object for it as /dev/mapper/csm_name . 


¢ Export a specified CSM container by removing its Device Mapper object from the /dev/mapper 
directory. This allows the container to be imported by other nodes. 
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A.6.1 


A.6.2 


You can specify devices to search for any of the options. Wildcards such as the question mark (?) and 
asterisk (*) can be used when specifying devices. A question mark replaces a character in that 
position. An asterisk replaces any number of characters in that position. 


¢ Section A.6.1, “Syntax,” on page 461 
¢ Section A.6.2, “Options,” on page 461 
¢ Section A.6.3, “Examples,” on page 463 


Syntax 
Open a console on a cluster node, then issue the command as the root user. 


/opt/novell/necs/bin/csmport [-v|-s] [-h] [-e devmapper object | -i container name 
-c container name] [device...] 


Options 

No options 
Use the command with no options to search the block devices (/dev/sd*) for containers. 
/opt/novell/nces/bin/csmport 


[devices] 


Use the command with no options and specify the devices to search in order to specify which 
devices to search for CSM containers. By default, the utility searches block devices (/dev/sd*) 
for containers. 


/opt/novell/ncs/bin/csmport [device...] 


When specifying devices, wildcards (? and *) can be used. 
Examples 


The following command searches the multipath device /dev/mapper/MD_EMC_005G for CSM 
containers. 


/opt/novell/ncs/bin/csmport -v /dev/mapper/MD_EMC_005G 


The following command uses three question mark wildcards to search multipath devices with 
any three characters in those positions in the device name: 


/opt/novell/ncs/bin/csmport -v /dev/mapper/MD_EMC_???G 


The following command uses an asterisk wildcard to search multipath devices with any number 
of characters in that position in the device name: 


/opt/novell/ncs/bin/csmport -v /dev/mapper/MD_EMC_* 
-h 
Prints the help page for this command. 


-c <container_name> [device...] 


Searches the /dev/sd* devices or specified devices for the named CSM container. 


/opt/novell/ncs/bin/csmport -c container_name 
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-i <container_name> [device...] 


Use this option to import a CSM container on a node for exclusive use in the cluster. The utility 
achieves this by searching for the container and if found, extracting the volume inside the 
container and exposing it exclusively at /dev/mapper/container_name. 


The utility uses the container name instead of the Linux POSIX volume name because some 
CSM containers might contain compatibility volumes, which do not have names. The /dev/ 
mapper/container_ name object can be mounted at the old mount point that was used for the 
shared Linux POSIX volume in that container. The mount point can have the same name or 
different name than the Device Mapper object. 


/opt/novell/nes/bin/csmport -i container name 


Example 


Suppose that you created a Linux POSIX cluster resource with the following settings on an OES 
2 server or an OES 1 server: 


RESOURCE_IP: 10.10.10.44 

CONTAINER_NAME: csm44 

EVMS_VOLUME NAME: lxvol44 

MOUNT_DEV: /dev/evms/$CONTAINER_NAME/$EVMS VOLUME NAME 
MOUNT_POINT: /mnt/users 


On an OES 11 or later server, you can use the following command to generate the Device 
Mapper object at /dev/mapper/csm44: 


/opt/novell/ncs/bin/csmport -i csm44 


The Device Mapper object can be mounted at the old mount point. 


The resulting settings are: 


RESOURCE IP: 10.10.10.44 

CONTAINER NAME: csm44 

MOUNT_DEV: /dev/mapper/$CONTAINER_NAME 
MOUNT_POINT: /mnt/users 


-e <devmapper_object> [device...] 


Use this option to export the Device Mapper object from the node. It removes the object from the 
/dev/mapper directory. Basically, the option undoes what the -i option did, so that the container 
can be imported by other nodes. 


/opt/novell/ncs/bin/csmport -e devmapper object 


Example 
The following command exports the Device Mapper object /dev/mapper/csm44. 


/opt/novell/ncs/bin/csmport -e csm44 
Verbose mode can be used with any of the options. 


-S 


Silent mode can be used with any of the options. 
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A.6.3 


Examples 


This section provides examples of typical tasks you perform when using the csmport command. 


+ 


+ 


+ 


“Scanning for CSM Containers” on page 463 

“Importing a CSM Container for Exclusive Use on a Node in a Cluster” on page 467 
“Exporting a CSM Container” on page 467 

“Searching for a Container on a Specified Device” on page 467 

“Searching for Containers on Multiple Devices with Wildcards” on page 467 


“Importing a CSM Container on a Specified Device” on page 467 


Scanning for CSM Containers 


Scan for CSM containers and check if they can be imported for use in the cluster. 


/opt/novell/ncs/bin/csmport -v 


In the following sample output, only device /dev/sdi has a CSM container CSM5GNoEVMSVo1 and can 
be imported to /dev/mapper/CSM5GNoEVMSVO1 for its exclusive use on the cluster node. 


Scan for CSM containers 


Search device '/dev/sdn' for CSM containers. 


Retrieve device information. 

Device '/dev/sdn': major=8, minor=208. 

Refresh device '/dev/sdn'. 

Open device '/dev/sdn' for reading. 

Check CSM metadata on device '/dev/sdn'. 
/dev/sdn is not a CSM container. 


Search device '/dev/sdm' for CSM containers. 


Retrieve device information. 

Device '/dev/sdm': major=8, minor=192. 

Refresh device '/dev/sdm'. 

Open device '/dev/sdm' for reading. 

Check CSM metadata on device '/dev/sdm'. 
/dev/sdm is not a CSM container. 


Search device '/dev/sdh' for CSM containers. 


Retrieve device information. 
Device '/dev/sdh': major=8, minor=112. 
Refresh device '/dev/sdh'. 
Open device '/dev/sdh' for reading. 
Check CSM metadata on device '/dev/sdh'. 
/dev/sdh has a CSM container. 
Cluster ID doesn't match. On disk = 37037513, in memory = 135657986. 
Container name ='AUTestContainer0Ol' on disk. 
Container is accessible (1). 


Search device '/dev/sdc' for CSM containers. 


Retrieve device information. 

Device '/dev/sdc': major=8, minor=32. 

Refresh device '/dev/sdc'. 

Open device '/dev/sdc! for reading. 

Check CSM metadata on device '/dev/sdc'. 
/dev/sde is not a CSM container. 
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Search device '/dev/sdl' for CSM containers. 
Retrieve device information. 
Device '/dev/sdl': major=8, minor=176. 
Refresh device '/dev/sdl'. 
Open device '/dev/sdl' for reading. 
Check CSM metadata on device '/dev/sdl'. 
/dev/sdl is not a CSM container. 


Search device '/dev/sdi' for CSM containers. 

Retrieve device information. 

Device '/dev/sdi': major=8, minor=128. 

Refresh device '/dev/sdi'. 

Open device '/dev/sdi' for reading. 

Check CSM metadata on device '/dev/sdi'. 
/dev/sdi has a CSM container. 
Container name ='CSMS5GNoEVMSVol' on disk. 
Container is accessible (4). 
No EVMS volume. 
New name: /dev/mapper/CSM5GNoEVMSVol 
Size: 10485757 sectors. 

Device '/dev/sdi' has a CSM container 'CSM5GNoEVMSVol' and can be converted to 

/dev/mapper/CSM5GNoEVMSVol . 


Search device '/dev/sdk' for CSM containers. 
Retrieve device information. 
Device '/dev/sdk': major=8, minor=160. 
Refresh device '/dev/sdk'. 
Open device '/dev/sdk! for reading. 
Check CSM metadata on device '/dev/sdk'. 
/dev/sdk is not a CSM container. 


Search device '/dev/sdg' for CSM containers. 
Retrieve device information. 
Device '/dev/sdg': major=8, minor=96. 
Refresh device '/dev/sdg'. 
Open device '/dev/sdg! for reading. 
Check CSM metadata on device '/dev/sdg'. 
/dev/sdg is not a CSM container. 


Search device '/dev/sdb' for CSM containers. 
Retrieve device information. 
Device '/dev/sdb': major=8, minor=16. 
Refresh device '/dev/sdb'. 
Open device '/dev/sdb' for reading. 
Check CSM metadata on device '/dev/sdb'. 
/dev/sdb is not a CSM container. 


Search device '/dev/sdt' for CSM containers. 
Retrieve device information. 
Device '/dev/sdt': major=65, minor=48. 
Refresh device '/dev/sdt'. 
Open device '/dev/sdt'! for reading. 
Failed to read the 1st sector of device '/dev/sdt': Input/output error (5). 


Search device '/dev/sdx' for CSM containers. 
Retrieve device information. 
Device '/dev/sdx': major=65, minor=112. 
Refresh device '/dev/sdx'. 
Open device '/dev/sdx! for reading. 
Failed to read the 1st sector of device '/dev/sdx': Input/output error (5). 
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Search device '/dev/sdj' for CSM containers. 

Retrieve device information. 

Device '/dev/sdj': major=8, minor=144. 

Refresh device !/dev/sdj'. 

Open device '/dev/sdj! for reading. 

Check CSM metadata on device '/dev/sdj'. 
/dev/sdj has a CSM container. 
Cluster ID doesn't match. On disk = 37037513, in memory = 135657986. 
Container name ='CMS4GCon' on disk. 
Container is accessible (4). 


Search device '/dev/sdy' for CSM containers. 
Retrieve device information. 
Device '/dev/sdy': major=65, minor=128. 
Refresh device '/dev/sdy'. 
Open device '/dev/sdy' for reading. 
Failed to read the lst sector of device '!/dev/sdy': Input/output error (5). 


Search device '/dev/sdu' for CSM containers. 
Retrieve device information. 
Device '/dev/sdu': major=65, minor=64. 
Refresh device '/dev/sdu'. 
Open device '/dev/sdu' for reading. 
Failed to read the 1st sector of device '/dev/sdu': Input/output error (5). 


Search device '/dev/sdd' for CSM containers. 
Retrieve device information. 
Device '/dev/sdd': major=8, minor=48. 
Refresh device '/dev/sdd'. 
Open device '/dev/sdd' for reading. 
Failed to read the lst sector of device '!/dev/sdd': Input/output error (5). 


Search device '/dev/sdq'! for CSM containers. 
Retrieve device information. 
Device '/dev/sdq': major=65, minor=0. 
Refresh device '/dev/sdq'. 
Open device '/dev/sdq'! for reading. 
Check CSM metadata on device '/dev/sdq'. 
/dev/sdq is not a CSM container. 


Search device '/dev/sds' for CSM containers. 
Retrieve device information. 
Device '/dev/sds': major=65, minor=32. 
Refresh device '!/dev/sds'. 
Open device '/dev/sds'! for reading. 
Failed to read the 1st sector of device '/dev/sds': Input/output error (5). 


Search device '/dev/sdv' for CSM containers. 
Retrieve device information. 
Device '/dev/sdv': major=65, minor=80. 
Refresh device '/dev/sdv'. 
Open device '/dev/sdv' for reading. 
Failed to read the lst sector of device '!/dev/sdv': Input/output error (5). 


Search device '/dev/sdaa' for CSM containers. 
Retrieve device information. 
Device '/dev/sdaa': major=65, minor=160. 
Refresh device '/dev/sdaa'. 
Open device '/dev/sdaa' for reading. 
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Failed to read the 1st sector of device '/dev/sdaa': Input/output error (5). 


Search device '/dev/sde' for CSM containers. 
Retrieve device information. 
Device '/dev/sde': major=8, minor=64. 
Refresh device '/dev/sde'. 
Open device '/dev/sde' for reading. 
Check CSM metadata on device '/dev/sde'. 
/dev/sde is not a CSM container. 


Search device '/dev/sdz' for CSM containers. 
Retrieve device information. 
Device '/dev/sdz': major=65, minor=144. 
Refresh device '/dev/sdz'. 
Open device '/dev/sdz' for reading. 
Failed to read the 1st sector of device '/dev/sdz': Input/output error (5). 


Search device '/dev/sdw' for CSM containers. 
Retrieve device information. 
Device '/dev/sdw': major=65, minor=96. 
Refresh device !/dev/sdw'. 
Open device '/dev/sdw' for reading. 
Failed to read the 1st sector of device '/dev/sdw': Input/output error (5). 


Search device '/dev/sdr' for CSM containers. 
Retrieve device information. 
Device '/dev/sdr': major=65, minor=16. 
Refresh device '/dev/sdr'. 
Open device '/dev/sdr' for reading. 
Failed to read the lst sector of device '!/dev/sdr': Input/output error (5). 


Search device '/dev/sdp' for CSM containers. 
Retrieve device information. 
Device '/dev/sdp': major=8, minor=240. 
Refresh device '/dev/sdp'. 
Open device '/dev/sdp!' for reading. 
Failed to read the 1st sector of device '/dev/sdp': Input/output error (5). 


Search device '/dev/sdo' for CSM containers. 
Retrieve device information. 
Device '/dev/sdo': major=8, minor=224. 
Refresh device !/dev/sdo'. 
Open device '/dev/sdo' for reading. 
Failed to read the 1st sector of device '/dev/sdo': Input/output error (5). 


Search device '/dev/sdf' for CSM containers. 
Retrieve device information. 
Device '/dev/sdf': major=8, minor=80. 
Refresh device '/dev/sdf'. 
Open device '/dev/sdf! for reading. 
Check CSM metadata on device '/dev/sdf'. 
/dev/sdf is not a CSM container. 


Search device '/dev/sda' for CSM containers. 
Retrieve device information. 
Device '/dev/sda': major=8, minor=0. 
Refresh device '/dev/sda'. 
Open device '/dev/sda' for reading. 
Check CSM metadata on device '/dev/sda'. 
/dev/sda is not a CSM container. 
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A.7 


Importing a CSM Container for Exclusive Use on a Node in a Cluster 


Use the -i option to import the CSM container named CSMS5GNoEVMSVol for exclusive use on a node 
in a cluster. 


/opt/novell/ncs/bin/csmport -i CSM5GNoEVMSVol 


This command generates the Device Mapper object /dev/mapper/CSM5GNoEVMSVol. You can map 
this object to the desired mount point. 


Exporting a CSM Container 
Use the -e option to export the Device Mapper object /dev/mapper/CSM5GNoEVMSVol. 
/opt/novell/necs/bin/csmport -e CSM5GNoEVMSVol 


This removes the object and allows the container to be imported by other nodes. 


Searching for a Container on a Specified Device 


Specify a device to be searched in order to speed up the search for a container or containers. For 
example, to search for CSM containers on a multpath device /dev/mapper/MD_EMC_005G, enter 


/opt/novell/nes/bin/csmport /dev/mapper/MD_EMC_005G 


Searching for Containers on Multiple Devices with Wildcards 
Specify multiple devices to be searched and use wildcards to include multiple devices of that type. 
/opt/novell/nes/bin/csmport -v /dev/mapper/MD_EMC_???G /dev/disk/by-id/dm-uuid- 


mpath-* 


Importing a CSM Container on a Specified Device 


When importing the CSMS5GNoEVMSVol1 container, specify the multipath device /dev/mapper/ 
MD_EMC_005G in order to speed up the search for the container. 


/opt/novell/nes/bin/csmport -i CSM5GNoEVMSVol /dev/mapper/MD_ EMC_005G 


ncs-configd.py Script (Pushing Configuration 
Updates to All Nodes) 


You can use the /opt /novell/ncs/bin/nes-configd.py script to push configuration updates to all 
nodes in a cluster. 


Syntax 
As the root user, enter 
/opt/novell/ncs/bin/nes-configd.py -init 


Novell Cluster Services can be running or not running when you issue the command. 
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A.8 ncs_install.py Script (Extending the Schema, 
Monitoring NDSD, or Removing NCS 
Configuration) 


You can use the /opt/novell/ncs/install/nes_install.py script to extend the eDirectory 
schema in a tree for cluster objects or to monitor the eDirectory daemon on a node. 

¢ Section A.8.1, “Extending the Schema,” on page 468 

¢ Section A.8.2, “Monitoring NDSD,” on page 469 

¢ Section A.8.3, “Removing NCS Configuration,” on page 471 


A.8.1 Extending the Schema 


You can extend the eDirectory schema for cluster objects before Novell Cluster Services is installed 
for the first time in the tree. This allows an eDirectory tree administrator to expand the schema, anda 
container administrator to install the software. The schema needs to be expanded only one time in the 
tree. See Section 5.2, “Extending the eDirectory Schema to Add Cluster Objects,” on page 72. 


After you run the script, the schema includes the Cluster object container and the following types of 
objects in it: 

+ Cluster Node objects 

+ Cluster Resource objects 

+ Cluster Template objects 


+ Volume Resource objects 


Syntax 
Run the following command as the root user: 


/opt/novell/ncs/install/nes_install.py -e -f <configuration_filename> 


Options 


-e 
Expand a specified eDirectory schema to add cluster objects. Use with the -£ option to specify a 
file that contains information about the LDAP server where the schema is stored. 

-f <configuration_file_name> 


Use with the -e option to specify information about the LDAP server where the schema to be 
expanded is stored. 


In a text editor, create a text file, specify the configuration information for the Novell Cluster 
Services cluster in it, then save the file. This file contains a password in clear text. For security 
reasons, ensure that you delete the file when you are done. 


The following lines are an example of the content of a file, with sample values. The directives are 
self-explanatory. 
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IMPORTANT: Ensure that you change the values inside the quotation marks to the actual 
settings for your cluster. 


CONFIG NCS LDAP TP="10.1.1.102" 
CONFIG NCS LDAP PORT="636" 

CONFIG NCS ADMIN DN="cn=admin.o=context" 
CONFIG NCS ADMIN PASSWORD="password" 


Example 


Create a configuration file on the server desktop and name it mytree_ncs_schema.txt. Open a 
terminal console on the server where you created the configuration file, then enter the following 
commands as the root user: 

mkdir -p /var/opt/novell/install 


/opt/novell/ncs/install/ncs_install.py -e -f /root/Desktop/mytree_ncs_schema.txt 


A.8.2 Monitoring NDSD 


You can monitor the status of the eDirectory daemon (ndsd) at the NCS level. It is disabled by default. 
The monitoring can be set independently on each node. On a node, if the eDirectory daemon does 
not respond to a status request within a specified timeout period, NCS can take one of three 
configurable remedy actions: an ndsd restart, a graceful node restart, or a hard node restart. See 
Section 8.8, “Configuring NCS to Monitor the eDirectory Daemon (ndsd),” on page 132. 


Syntax 


/opt/novell/ncs/install/ncs_install.py 
-m <display|disable|restart-ndsd| reboot -node|hard-reboot |help> 
[-i <interval_value>] 
[-t <timeout_value>]] 


The settings apply to an individual node. Different nodes can have different settings. 


The settings take effect immediately. You do not need to start or restart any services. 


Options 


-m <display|disable|restart-ndsd|reboot-node|hard-reboot|help> 


Monitor the eDirectory daemon (ndsq) status on this node. Use this option with the -i and -t 
options. 


display 

Display the current settings for monitoring of the eDirectory ndsd daemon on this node. 
disable 

Turn off the monitoring of the eDirectory ndsd daemon on this node. 
restart-ndsd 


Enable monitoring of the eDirectory ndsd daemon on this node and set a remedy action of a 
restart for the eDirectory ndsd daemon. 


reboot-node 


Enable monitoring of the eDirectory ndsd daemon on this node and set a remedy action of a 
graceful restart for the node. 
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hard-reboot 


Enable monitoring of the eDirectory ndsd daemon on this node and set a remedy action of a 
hard restart for the node. 


help 
Display the usage information for the -m option. 


-i <interval_value> 


Specify the interval of time in seconds to check the status of ndsd on this node. The minimum 
interval is 16 seconds. Use this option with the -m and -t options. 


-t <timeout_value> 


Specify a timeout value in seconds to wait for a response from ndsd before enforcing the 


configured remedy action. The minimum timeout is 8 seconds. Use this option with the -m and - 


i options. 


Examples 


Example 1: Display current settings for ndsd monitoring. 


# /opt/novell/ncs/install/ncs_install.py -m display 


NDSD 


monitoring is enabled. 


interval = 90 seconds, timeout = 20 seconds and remedy action is reboot node hard. 


Example 2: Enable ndsd monitoring with an interval of 60 seconds, timeout of 15 seconds, and 
remedy action of rebooting gracefully. 


# /opt/novell/ncs/install/ncs_install.py -m reboot-node -i 60 -t 15 


NDSD 


monitoring is enabled. 


interval = 60 seconds, timeout = 15 seconds and remedy action is reboot node. 


Example 3: Change the remedy action to restart ndsd. 


# /opt/novell/ncs/install/ncs_install.py -m restart-ndsd -i 60 -t 15 


NDSD 


monitoring is enabled. 


interval = 60 seconds, timeout = 15 seconds and remedy action is restart ndsd. 


Example 4: Disable ndsd monitoring. 


# /opt/novell/ncs/install/ncs_install.py -m disable 


NDSD 


monitoring is not enabled (3). 


Example 5: View usage for ndsd monitoring. 


# /opt/novell/ncs/install/ncs_install.py -m help 
Usage: /opt/novell/ncs/install/ncs_install.py -m display|disable|restart-ndsd| reboot -node |hard- 


reboot |help [-i interval_value] [-t timeout_value] 

-m display: Display the current NDSD monitoring settings 

-m disable: Disable NDSD monitoring 

-m restart-ndsd: Enable NDSD monitoring and set remedy action to restarting NDSD 

-m reboot-node: Enable NDSD monitoring and set remedy action to rebooting node 

-m hard-reboot: Enable NDSD monitoring and set remedy action to rebooting node hard 

-m help: Print this help page 

-i interval _value: Specify in seconds how frequently the monitor process checks NDSD 

-t timeout_value: Specify in seconds how long the monitor process waits for the checking operation 
NDSD monitoring is not enabled (1). 
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A.8.3 


Removing NCS Configuration 


You can use the /opt/novell/nes/install/nces_install.py -r script to remove cluster 
configuration information from a node to return it to a pre-configured state. This is useful for the 
following scenarios: 


+ Ifthe Novell Cluster Services configuration is unsuccessful, you might have a partial 
configuration that prevents you from properly configuring the node for a cluster. 
¢ You want to move a node from one cluster to another cluster. 
After you remove the cluster configuration information, you can start over with the configuration of 


Novell Cluster Services on the node as described in Section 5.5, “Configuring Novell Cluster 
Services,” on page 79. 


Syntax 


You must stop NCS (rcnovell-ncs stop) before you run the command. Run the command as the 
root user. 


/opt/novell/necs/install/ncs_ install.py -r [-f <configuration_file name>] 


Without the -£f option or applicable variables in the configuration file, /opt /novell/nes/install/ 
nces_install.py prompts you to enter needed information. 


You can check the return code ($?) of the command to see if the command is successful. Detailed log 
information is appended to /var/opt/novell/install/ncslog. 


Options 


-f 
Clean up an unsuccessful Novell Cluster Services configuration on a node, or remove the 
configuration information so that you can move a node from one cluster to another. 

-f <configuration_file_name> 


Use with the -r option to specify credentials for the node with the unsuccessful Novell Cluster 
Services configuration. 


In a text editor, create a text file, specify the credentials for the Novell Cluster Services cluster in 
it, and then save the file. This file contains a password in clear text. For security reasons, ensure 
that you delete the file when you are done. 


The following lines are an example of the content of a file, with sample values. The directives are 
self-explanatory. 


IMPORTANT: Ensure that you change the values inside the quotation marks to the actual 
settings for your cluster. 


CONFIG _NCS_CLUSTER_DN="cn=clus1,ou=ncs,o=novell" 
CONFIG NCS ADMIN DN="cn=admin.o=novell" 
CONFIG NCS ADMIN PASSWORD="password" 
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Example 


A cluster configuration process failed. You must remove the unsuccessful Novell Cluster Services 
configuration information from the node before you can re-try the configuration. 
1 Open a terminal console as the root user. 


2 Stop Novell Cluster Services if it is running. 
renovell-ncs stop 


3 Do either of the following: 


+ In atext editor, create a configuration file on the server desktop, add the cluster credentials, 
and save the file as my_cluster_credentials.conf. 


At the command prompt, enter 
/opt/novell/ncs/install/ncs_install.py -r -f /root/Desktop/my_ cluster _credentials.conf 

+ At the command prompt, enter the command, then reply with the credentials when you are 
prompted: 


# /opt/novell/nes/install/ncs install.py -r 
Please enter the DN for the admin (cn=admin,o=novell) : 
please enter the password for cn=admin,o=novell: 


4 Check the return code to see if the command is successful: 
$? 


5 After the successful removal of the cluster configuration information, you can configure Novell 
Cluster Services on the node as described in Section 5.5, “Configuring Novell Cluster Services, 
on page 79. 


” 


A.9 ncs_ncpserv.py Script (Creating an NCP Virtual 
Server Object for a Clustered LVM Volume Group) 


The /opt/novell/necs/bin/nes_ncpserv.py script creates a virtual NCP Server object (NCS :NCP 
Server) in eDirectory, and associates it with none, one, or multiple NCP volumes that you specify. It 
automatically renames the NCP Volume objects to use the cluster name instead of the server name 
where the NCP volume was created. NCP clients access files on the Linux POSIX volume via the 
virtual server name. 

¢ Section A.9.1, “Syntax,” on page 472 

è Section A.9.2, “Options,” on page 473 


¢ Section A.9.3, “Examples,” on page 473 


A.9.1 Syntax 


At the command prompt on the master node of the cluster, enter the following command as the root 
user: 


/opt/novell/necs/bin/ncs_ ncpserv.py -c <lx_ volume _name> -i <resource_ip_ address> 
[-v <ncp_volume_name| "ncp_volume_namel:ncp_volume_name2:..."> ] 
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A.9.2 


A.9.3 


Options 


-c </Ix_volume_name> 


Create a virtual NCP Server object for the specified volume. 


-i <resource_ip_address> 


Specify a unique static IP address to use for the cluster resource. 


-v <ncp_volume_name | "ncp_volume_name1i:ncp_volume_namez2.:..."> 


Use this option to specify one or multiple volumes on the Linux cluster resource that need a 
virtual NCP Server object to be created and bound to the specified IP address. If the -v option is 
not specified, all of the NCP volumes that currently exist on the Linux POSIX cluster resource 
are bound to the IP address. 


If you enter multiple volume names, use colons to delimit the names and put quotation marks 
around the list of names. Volume names can be listed by the volume name (My_NNCP_VOLO06) or 


by the volume distinguished name (cn=CLUS_02_ MY NNCP VOL06,o0=novell1), or any 
combination of the two methods. 


Examples 


In the following examples, the resource IP address is 10.10.10.44, the cluster name is cluster1 and 


the cluster context is ou=clusters,o=mycompany. 

Example 1 

To specify a single NCP volume named USERS on the 1xvol144 cluster resource, enter 
./nes_nepserv.py -c lxvol44 -i 10.10.10.44 -v USERS 

The following confirmation message is displayed: 


NCP Server 'cn=cluster1_lxvol44_server,ou=clusters,o=mycompany' created. 


Object 'cn=servername_USERS, ou=clusters,o=mycompany! renamed to 
'cn=clusterl USERS, ou=clusters,o=mycompany'. 

The volume name you need to use in the scripts is: USERS 

NCP server 'cn=clusterl_ 1lxvol44 server,ou=clusters,o=mycompany' and volume 
'cn=clusterl USERS, ou=clusters,o=mycompany' are linked with each other. 


Example 2 
To specify multiple NCP volumes on the 1xvo144 cluster resource, enter 


./nes_nepserv.py -c lxvol44 -i 10.10.10.44 -v 
"USERS :MY_NCP_VOL06 :cn=servername_MY_NCP_VOL07 , ou=clusters,o=novell" 


Console Commands for Novell Cluster Services 


473 


A.10 


A.10.1 


The following confirmation message is displayed: 


NCP Server 'cn=clusterl_1lxvol44 server,ou=clusters,o=mycompany' created. 


Object 'cn=servername_ USERS, ou=clusters,o=mycompany' renamed to 
'cn=clusterl_ USERS, ou=clusters,o=mycompany'. 

The volume name you need to use in the scripts is: USERS 

NCP server 'cn=clusterl_ 1lxvol44 server,ou=clusters,o=mycompany' and volume 
'cn=clusterl USERS, ou=clusters,o=mycompany' are linked with each other. 


Object 'cn=servername_MY_NCP_VOL06,ou=clusters,o=mycompany' renamed to 
'cn=clusterl MY _NCP_VOL06,ou=clusters,o=mycompany'. 

The volume name you need to use in the scripts is: MY_NCP_VOL06 

NCP server 'cn=clusterl_ 1lxvol44 server,ou=clusters,o=mycompany' and volume 
‘cn=cluster MY NCP _VOL06,ou=clusters,o=mycompany' are linked with each other. 


Object 'cn=servername MY NCP _VOLO7,ou=clusters,o=mycompany' renamed to 
'cn=clusterl MY _NCP_VOLO7,ou=clusters,o=mycompany'. 

The volume name you need to use in the scripts is: MY _NCP_VOL07 

NCP server 'cn=clusterl_1lxvol44 server,ou=clusters,o=mycompany' and volume 
'cn=cluster MY _NCP_VOLO7,ou=clusters,o=mycompany' are linked with each other. 


ncs_resource_scripts.pl Script (Modifying 
Resource Scripts Outside of iManager) 


You can use the /opt/novell/ncs/bin/nes_resource_scripts.p1 script to modify resource 
scripts without using iManager. You can add, remove, or modify the commands in the script, or 
retrieve its scripts to search for information from the script. You can issue the command from the 
command line or in a script. This capability is very useful when you need to make the same script 
change to multiple resources in a cluster. 


Given a resource name, the ncs_resource_sripts.p1 tool does one of two things: 


+ Read: Retrieves the specified resource’s scripts and prints them to standard output. 


¢ Write: Gathers the script information from standard input and updates the specified resource’s 
scripts. 


+ 


Section A.10.1, “Syntax,” on page 474 


+ 


Section A.10.2, “Options,” on page 475 


+ 


Section A.10.3, “Examples,” on page 475 


Syntax 


At the command prompt on the master node of the cluster, enter the following command as the root 
user: 


/opt/novell/ncs/bin/ncs_resource_scripts.pl <--help|-h|-?> 
/opt/novell/ncs/bin/ncs_resource_scripts.pl [--read|--write] resource name 


You can redirect standard I/O to a file, and change the textual file any way you want. 


A return code 0 indicates that the operation is successful. Otherwise, errors will be printed in standard 
error. 
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A.10.2 Options 


--help, -h, -? 
Prints usage help and exits. 


--read 
Retrieves the specified resource’s scripts and prints them to standard output. 
You can redirect standard output to a file, and modify the scripts in the file. 


--write 
Gathers the script information from standard input and updates the specified resource’s scripts. 


You can redirect standard input to a file that contains the modified scripts. 


A.10.3 Examples 


In the following examples, enter the /opt /novell/ncs/bin/nces_ resource _scripts.pl command 
at the command prompt on the master node of the cluster as the root user. 


+ “Example 1: Read the Scripts in Standard I/O” on page 475 
+ “Example 2: Redirect the Scripts from Standard I/O to a File” on page 475 
+ “Example 3: Delete the CIFS Workaround Line from Scripts” on page 475 


+ “Example 4: Get the Volume Name from the Resource Load Script” on page 476 


Example 1: Read the Scripts in Standard I/O 


At the command prompt, enter the following commands to read and write the scripts to and from the 
same file: 


/opt/novell/nes/bin/nes_resource_scripts.pl --read P_119 93 SERVER 


Example 2: Redirect the Scripts from Standard I/O to a File 


At the command prompt, enter the following commands to read and write the scripts to and from the 
same file: 


# /opt/novell/ncs/bin/ncs_resource_scripts.pl --read POOL_01_ SERVER > tmp.scripts 


In a text editor, modify the scripts as needed in the output file tmp. scripts, then redirect the content 
of the modified file to be used with the --write option. 


# /opt/novell/ncs/bin/ncs_resource_scripts.pl --write POOL _01 SERVER < tmp.scripts 


Example 3: Delete the CIFS Workaround Line from Scripts 


For scripts where an extra CIFS line was added as a workaround for a timing issue, remove the line. 
At the command prompt, enter the following command: 


# /opt/novell/ncs/bin/ncs_resource_scripts.pl --read POOL_01 SERVER | sed '/novcifs -sln/d' | /opt/ 
novell/ncs/bin/ncs_resource_scripts.pl --write POOL _01 SERVER 
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A.11 


A.11.1 


A.11.2 


Example 4: Get the Volume Name from the Resource Load Script 


Use grep with the ncs_ resource _scripts.p1 tool to parse the standard output and get the volume 
name from the nepcon mount command in the resource load script. At the command prompt, enter 
the following command: 


# /opt/novell/ncs/bin/ncs_resource_scripts.pl POOL _01_ SERVER | grep -ml -o 
"*exit_on_error[[:space:]]\+ncpcon[[:space:]]\+mount[[:space:]]\+\w\+" | cut -d' ' -f4 


NCPCON Mount Command for NCP and NSS 
Volumes 


Use the ncpcon mount command to mount an NCP volume or NSS volume on your Linux server. 
This command makes the volume accessible to NCP clients. 


¢ Section A.11.1, “Syntax,” on page 476 

¢ Section A.11.2, “NCP Volume Examples,” on page 476 
¢ Section A.11.3, “NSS Volume Examples,” on page 477 
¢ Section A.11.4, “Other Examples,” on page 477 


Syntax 
mount < all | volume name | volume_name=volume_id,path=/volume_mntpoint > 


Replace volume_name with the name of the NSS volume or NCP volume, such as voL1. To mount all 
local NCP and NSS volumes, replace volume_name with a11. A clustered NCP volume or NSS 
volume is mounted when its cluster resource is brought online. 


Replace volume_id with a value from O to 254 as the server volume ID. It is not necessary to 
manually specify a volume ID for a locally mounted volume. NCP automatically assigns unique 
volume IDs to locally mounted NCP volumes and NSS volumes in increasing order, from 0 to 254. IDs 
O and 1 are reserved for the sys and _admin volumes. When the command is used in a cluster 
resource script, the volume ID must be specified to ensure that the volume ID is unique across all 
cluster nodes where the volume will be mounted. By convention in clusters, the volume IDs are 
assigned in decreasing order, from 254 to 0. 


NCP Volume Examples 


For an NCP volume created on a Linux POSIX file system, replace /volume_mntpoint with the Linux 
path of the mount point for the NCP share. Typically, this path is mount point of the Linux volume; that 
is, the NCP share is created at the root of the Linux volume. The path must exist on all nodes in the 
cluster. 


If an NCP volume is mounted locally, the mount path is stored in the /etc/fstab file, so it is not 
necessary to specify a mount path. For example: 


nepcon mount VOL1 


The mount path for the NCP volume is required when you use the command in a cluster resource 
load script. For example, if you use NSSMU to create and NCP enable a clustered Linux LVM volume 
myvol with a mount point of /usr/novell/myvol, the NCP volume name (share name) is MYVOL, 
and the resource load script includes the following definitions for variables used in the command: 
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A.11.3 


A.11.4 


# define the mount point path of the Linux volume 
MOUNT_PATH=/usr/novell/myvol 


# define the NCP volume name 
NCP_VOLUME=MYVOL 


exit_on_error ncpcon mount $NCP_VOL=253,path=$MOUNT_PATH 


NSS Volume Examples 


For an NSS volume, the default mount path is /media/nss/<nss_volume_name>. For example, if you 
create an NSS volume named USERS, the default mount path is /media/nss/USERS. If you use the 
default path for NSS volumes, it is not necessary to include the path option for local mounts: 


ncepcon mount USERS 


The default path is also not required in a cluster script, but a volume ID that is unique across all 
cluster nodes must be specified: 


exit_on_error ncpcon mount USERS=252 


In a cluster, you cannot rename the mount point path. The default mount point path of /media/nss/ 
<volume_name> applies. 


exit _on_error ncpcon mount <volumename>=<volume_ID> 
For example: 

exit_on_error ncpcon mount USERS=252 

The volume is mounted at /media/nss/USERS. 


You can specify mount options for the NSS volume by using the /opt switch in the command. For 
example, you can specify the name space to use by using the /opt=ns=<long|unix|dos|mac> 
command. 


# specify the name space to use when mounting the volume 
exit _on_error ncpcon mount USERS=252 /opt=ns=unix 


Other Examples 


ncepcon mount sys 
ncpcon mount all 
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B Files for Novell Cluster Services 


Knowing the location and purpose of the files that make up Novell Cluster Services can be useful in 
helping you troubleshoot problems and resolve version issues. Table B-1 lists the path and purpose 


for some of the files that are part of Novell Cluster Services. 


Table B-14 Location and Purpose of Novell Cluster Services Files 


NCS File Name and Path 


/etc/init.d/novell-ncs 


Purpose 


LSB Compliant Service 


/etc/opt/novell/ncs/<node_name> 


Configuration file for a specific cluster node 


/etc/opt/novell/nes/clstrlib.conf 


Cluster configuration file 


/lib/modules/kernel_dir/ncs/clstrlib.ko 


Kernel module. Replace kernel_dir with the 
current kernel directory. Use uname -r to see 
the current kernel directory. 


/lib/modules/kernel_dir/nces/cma.ko 


Kernel module. Replace kernel_dir with the 
current kernel directory. Use uname -r to see 
the current kernel directory. 


/lib/modules/kernel_dir/ncs/cmsg.ko 


Kernel module. Replace kernel_dir with the 
current kernel directory. Use uname -r to see 
the current kernel directory. 


/lib/modules/kernel_dir/nces/crm.ko 


Kernel module. Replace kernel_dir with the 
current kernel directory. Use uname -r to see 
the current kernel directory. 


/lib/modules/kernel_dir/ncs/css.ko 


Kernel module. Replace kernel_dir with the 
current kernel directory. Use uname -r to see 
the current kernel directory. 


/lib/modules/kernel_dir/ncs/cvb.ko 


Kernel module. Replace kernel_dir with the 
current kernel directory. Use uname -r to see 
the current kernel directory. 


/lib/modules/kernel_dir/ncs/gipc.ko 


Kernel module. Replace kernel_dir with the 
current kernel directory. Use uname -r to see 
the current kernel directory. 


/lib/modules/kernel_dir/ncs/sbd.ko 


Kernel module. Replace kernel_dir with the 
current kernel directory. Use uname -r to see 
the current kernel directory. 


/lib/modules/kernel_dir/ncs/sbdlib.ko 


Kernel module. Replace kernel_dir with the 
current kernel directory. Use uname -r to see 
the current kernel directory. 


/lib/modules/kernel_dir/ncs/vipx.ko 


Kernel module. Replace kernel_dir with the 
current kernel directory. Use uname -r to see 
the current kernel directory. 
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NCS File Name and Path 


/lib/modules/kernel_dir/ncs/vll.ko 


Purpose 


Kernel module. Replace kernel_dir with the 
current kernel directory. Use uname -r to see 
the current kernel directory. 


/opt/novell/ncs/bin/adminfs Cluster management (iManager and CLI) 

/opt/novell/necs/bin/ClusterCli.pl Cluster CLI engine 

/opt/novell/ncs/bin/ClusterCliSnapinInterface.pm Cluster CLI engine 

/opt/novell/ncs/bin/ClusterCliUtils.pm Cluster CLI engine 

/opt/novell/ncs/bin/csmport CSM Import/Export utility 

/opt/novell/ncs/bin/dotoutparser.pl DotOutParser utility 

/opt/novell/ncs/bin/1dnecs Loads NCS; used by the Cluster Start 
command. 

/opt/novell/ncs/install/ncs_install.py Script to extend the eDirectory schema or to 
configure eDirectory monitoring 

/opt/novell/ncs/bin/ncs_ncpserv.py Virtual NCS NCP Server Object script 

/opt/novell/ncs/bin/NCS_STONITH_SCRIPT file An executable file that you create to 
authenticate to your power controller and turn 
off the power, cycle the power, or reset the 
power for the node. The presence of the file 
enables the STONITH feature for the node. 

/opt/novell/ncs/bin/ncs-configd.py Cluster configuration daemon 

/opt/novell/ncs/bin/ncs-emaild Cluster email daemon 

/opt/novell/ncs/bin/ncs-resourced.py Daemon used to run load and unload scripts. 

/opt/novell/ncs/bin/ncstempl .py Used to install or update cluster resource 
templates in the Cluster container 

/opt/novell/ncs/bin/sbdutil SBD partition utility 

/opt/novell/ncs/bin/Snapins/ Cluster CLI command 

ClusterCliSnapin Alert.pm 

/opt/novell/ncs/bin/Snapins/ Cluster CLI command 

ClusterCliSnapin_ Convert .pm 

/opt/novell/ncs/bin/Snapins/ Cluster CLI command 

ClusterCliSnapin Down.pm 

/opt/novell/ncs/bin/Snapins/ Cluster CLI command 

ClusterCliSnapin_ Exec.pm 

/opt/novell/ncs/bin/Snapins/ Cluster CLI command 

ClusterCliSnapin Info.pm 

/opt/novell/ncs/bin/Snapins/ Cluster CLI command 

ClusterCliSnapin_ Join.pm 

/opt/novell/ncs/bin/Snapins/ Cluster CLI command 

ClusterCliSnapin Leave.pm 
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NCS File Name and Path 


Purpose 


/opt/novell/ncs/bin/Snapins/ Cluster CLI command 

ClusterCliSnapin Maintenance.pm 

/opt/novell/ncs/bin/Snapins/ Cluster CLI command 

ClusterCliSnapin Migrate.pm 

/opt/novell/ncs/bin/Snapins/ Cluster CLI command 

ClusterCliSnapin Monitor.pm 

/opt/novell/ncs/bin/Snapins/ Cluster CLI command 

ClusterCliSnapin Offline.pm 

/opt/novell/ncs/bin/Snapins/ Cluster CLI command 

ClusterCliSnapin Online.pm 

/opt/novell/ncs/bin/Snapins/ Cluster CLI command 

ClusterCliSnapin_ Pools.pm 

/opt/novell/ncs/bin/Snapins/ Cluster CLI command 

ClusterCliSnapin Rename.pm 

/opt/novell/ncs/bin/Snapins/ Cluster CLI command 

ClusterCliSnapin Resources.pm 

/opt/novell/ncs/bin/Snapins/ Cluster CLI command 

ClusterCliSnapin Restart.pm 

/opt/novell/ncs/bin/Snapins/ Cluster CLI command 

ClusterCliSnapin_ Set.pm 

/opt/novell/ncs/bin/Snapins/ Cluster CLI command 

ClusterCliSnapin Stats.pm 

/opt/novell/ncs/bin/Snapins/ Cluster CLI command 

ClusterCliSnapin Status.pm 

/opt/novell/ncs/bin/Snapins/ Cluster CLI command 

ClusterCliSnapin View.pm 

/opt/novell/ncs/bin/uldnes Unloads NCS; used by the Cluster Stop 
command. 

/opt/novell/ncs/lib/ncs-1.0.0.so0 NCS snap-in 

/opt/novell/nes/1lib/ncesfuncs Shared library commands for load/unload 
scripts 

/opt/novell/ncs/schema/ncpserver.1ldif NCS schema file 

/opt/novell/ncs/schema/ncpserver.preldif NCS schema file 

/opt/novell/ncs/schema/ncs.1dif NCS schema file 

/opt/novell/ncs/schema/nes.sch NCS schema file 

/opt/novell/oes-install/util/ Path to the extend_schema command 

/usr/include/nessdk.h NCS SDK 

/usr/lib/libncssdk.so NCS SDK 

/usr/lib/libnessdk.so.1.0.0 NCS SDK 


/usr/sbin/rcnovell-nes 


Link to /etc/init.d/novell-ncs 
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NCS File Name and Path Purpose 


/usr/share/man/man7/sbdutil.7.gz SBDUTIL man page 
/usr/share/man/man8/cluster.8.gz CLUSTER man page 
/usr/share/man/man8/csmport.8.gz CSMPORT man page 
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C Electing a Master Node 


C.1 


In a Novell Cluster Services cluster, the master node monitors the health of the cluster nodes. It also 
synchronizes updates about the cluster to eDirectory. The first server that comes up in a cluster is 
automatically assigned the cluster IP address and becomes the master node. If the master node fails, 
Cluster Services migrates the cluster IP address to another server in the cluster, and that server 
becomes the master node. 


If a slave node fails to receive heartbeat packages from a master node within a predefined tolerance, 
the slave assumes that the master has left the cluster or is experiencing problems. The slave node, 
together with other slave nodes, tries to elect a new master node. The goal is to identify a node witha 
higher IP address that can be seen by the most member nodes. Each slave node follows the same 
process to identify a master candidate. If multiple masters are elected, the SBD (split-brain detector) 
guarantees that only one master survives and fences the other masters and their members. 


Novell Cluster Services for Novell Open Enterprise Server (OES) 11 SP1 introduces some 
intelligence in the master election process when the master leaves a cluster (voluntarily or 
involuntarily). The same master is elected under both the old and new algorithms, but the conclusion 
is reached sooner, especially for larger clusters. The new algorithm substantially reduces the time 
needed for master election in some cases. The algorithm is available for OES 11 SP1 and later as 
well as in the September 2012 Scheduled Maintenance for OES 11 and OES 2 SP3. 


This section briefly describes the old and new master-election algorithms. 


¢ Section C.1, “Master-Election Algorithm for OES 11 and Earlier,” on page 483 
¢ Section C.2, “New Master-Election Algorithm for OES 11 SP1 and Later,” on page 484 


Master-Election Algorithm for OES 11 and Earlier 


In Novell Cluster Services for OES 11 and earlier, after losing contact with the master node, a slave 
node attempts to find a node with a higher IP address that will act as master. The logic flow for the 
master-election algorithm is represented in Figure C-1, “Master-Election Algorithm for OES 11 Initial 
Release and Earlier Versions,” on page 484. 


Before polling other nodes, a node checks its own network adapter status. If the adapter is down, the 
node immediately promotes itself as the master. Rather than polling and waiting for replies that 
cannot come back, the node can jump directly to the ultimate conclusion for that node that it is the 
only node remaining in the cluster. This shortcut can substantially shorten the election process if the 
network outage is caused by a network adapter failure. However, if the cause for a network outage 
occurs further upstream by a cable or switch failure, the node follows the election process, unaware 
that it is awaiting a response that cannot arrive. 


If a node’s adapter is working, it begins a process to find a live node with a higher IP address than its 
own: 


1. Anode determines if there are other nodes (excluding the old master) with an IP address higher 
than its own. If it has the highest IP address, it promotes itself as the master. 


2. If there are nodes with higher IP addresses, a node asks a member node with the highest IP 
address (excluding the old master) to be the new master. It waits for a predetermined tolerance 
to see if that master candidate node will start acting like a master and send it heartbeat 
packages. If a heartbeat package arrives, the node becomes a slave of its elected master. 
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3. If no heartbeat package arrives, the node then picks the member node with the second highest 
IP address and repeats the same procedure. 


4. If there are no responses from nodes with a higher IP address than its own, a node promotes 
itself as the master. 


If more than one node is elected as master at the end of the process, the SBD guarantees that only 
one master survives and fences the other masters and their members. Describing how the SBD 
addresses all possible situations to determine the master is beyond the scope of this document. Let’s 
consider a simple scenario with multiple master candidates. The SBD kills any master candidate 
node whose adapter is down. If a master candidate was the old master, it becomes the new master. 
Otherwise, the master candidate with the highest IP address wins. 


The master election process can take time because a node sequentially asks each potential master 
node to become the master and waits for a response before trying the next higher IP address. If a 
large cluster (8+ nodes) loses LAN connections among all the nodes, it can take up to 3 minutes to 
elect all of the new masters. The node with lowest IP address tries almost all of the other nodes. 


Figure C-1 Master-Election Algorithm for OES 11 Initial Release and Earlier Versions 
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C.2 New Master-Election Algorithm for OES 11 SP1 
and Later 


In Novell Cluster Services for OES 11 SP1 and later (and fully patched OES 11 and OES 2 SP3), after 
losing contact with the master node, a slave node attempts to find a node with a higher IP address 


that will act as master, but it also uses intelligence to determine which other nodes are capable of 
responding. The new algorithm elects the same master as the old algorithm, but the time to make the 
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decision is deterministic and the process is more efficient. The logical flow for the master-election 
algorithm is represented in Figure C-2, “Master-Election Algorithm for OES 11 SP1 and Later (and 
Fully Patched OES 11 and OES 2 SP3),” on page 486. 


In the new master-election algorithm, after a slave determines that its adapter is working, it 
broadcasts a ping to all of the cluster nodes. The purpose of pinging is to identify whether the node 
can communicate with other nodes and which ones. This helps address a situation where LAN 
communications are down between some nodes, such as a cable or switch failure. 


If there are nodes with higher IP addresses than its own, a node asks a member node with the 
highest IP address (excluding the old master) to be the new master. It waits for a predetermined 
tolerance to see if that master candidate node will start acting like a master and send it heartbeat 
packages. If a heartbeat package arrives, the node becomes a slave of its elected master. 


Sending the first master request in the old manner serves two purposes: 


¢ It maintains some compatibility with older versions of Novell Cluster Services. 
¢ It provides some action while waiting for the ping replies to come in. 


If the member with the highest IP address starts acting as the new master (in time), the election is 
over for this node. 


If no heartbeat packages arrive, the node then focuses on member nodes with higher IP addresses 
that have either pinged or replied to its ping. This helps the node by-pass waiting periods for requests 
to nodes that are unable to communicate. The node picks the member node with the highest IP 
address, and asks it to be the new master. It waits for a predetermined tolerance to see if that master 
candidate node will start acting like a master and send it heartbeat packages. The request to this 
node is almost certain to succeed since it is known to be able to communicate. 


If no heartbeat packages arrive, the node picks the member node with the next highest IP address 
that has either pinged or replied to the ping, and the election goes on. 


If there are no responses from nodes with a higher IP address than its own, a node promotes itself as 
the master. 


If more than one node is elected as master at the end of the process, the SBD guarantees that only 
one master survives and fences the other masters and their members. 


The benefits of the new master-election algorithm are: 


+ The new algorithm elects the same master that would be determined with the old algorithm. 


+ The time to elect a master node is deterministic, regardless of the size of the cluster or the 
nature of the problem. 


+ The traditional master-election logic is mostly preserved. 
+ The first master request goes out while waiting for nodes to respond to pings, or to time out. 


+ The second master request goes to a node that is known to be able to communicate, and is 
almost certain to succeed. 


¢ Election time is substantially decreased in some cases. 


Electing a Master Node 485 


Figure C-2 Master-Election Algorithm for OES 11 SP1 and Later (and Fully Patched OES 11 and OES 2 SP3) 
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Clusters Plug-In Changes for Novell 
iManager 2.7.5 


The Clusters plug-in for Novell iManager 2.7.5 or later supports the management of OES and 
NetWare clusters and resources. The availability of Novell Cluster Services features depends on the 
version of Novell Cluster Services and the server platform that are installed on the cluster being 
managed. You can use either the old plug-in or the new plug-in to manage a cluster and its resources. 


Understanding the Cluster Plug-In’s New Interface 


The Clusters plug-in for Novell iManager 2.7.5 or later has been reorganized. In Roles and Tasks 
under Clusters, the Cluster Manager, BCC Manager, Cluster Event Log, and Cluster Options menu 
items have been replaced with two menu options: 


¢ My Clusters: The logged-in cluster administrator can set up a personalized list of clusters to 
manage. This allows an administrator to view at a glance the status of multiple clusters. An 
administrator can also customize the display to sort the entries, modify the columns, or filter the 
entries. The list of clusters and display preferences persist between the administrator’s logins to 
iManager on the same server. See Section 8.2, “Setting Up a Personalized List of Clusters to 
Manage,” on page 117. 


+ My Resources: The logged-in cluster administrator can set up a personalized list of cluster 
resources to manage. This allows an administrator to view at a glance the status of multiple 
cluster resources for multiple clusters. An administrator can also customize the display to sort 
the entries, modify the columns, or filter the entries. The list of cluster resources and display 
preferences persist between the administrator’s logins to iManager on the same server. See 
Section 10.2, “Setting Up a Personalized List of Resources to Manage,” on page 195. 


From a custom My Clusters page or a My Resources page, you can click the name link of a cluster to 
manage the cluster. The old plug-in’s Clusters menu options are available here as tabs: Cluster 
Manager, BCC Manager, Cluster Event Log, and Cluster Options. 


Upgrading the Clusters Plug-In 


If you use Role-Based Services (RBS), upgrading the Clusters plug-in does not automatically update 
the RBS settings. The RBS Configuration page reports that the Clusters plug-in is out-of-date. The 
plug-in must be reinstalled on the RBS Configuration page in order to pick up the My Clusters and My 
Resources menu options. See Section 5.7.4, “Updating Role-Based Services for the Clusters Plug-In 
after Upgrading to OES 11 SP1 or later,” on page 94. 


Comparing Tasks in the Old and New Clusters Plug-Ins 


Use the tables in this section to understand how to perform tasks in the old Clusters plug-in for Novell 
iManager 2.7.4 and the new Clusters plug-in for Novell iManager 2.7.5 and later. 

¢ Table D-1, “Selecting a Cluster to Manage,” on page 488 

¢ Table D-2, “Managing a Cluster,” on page 488 

¢ Table D-3, “Accessing Cluster Properties,” on page 489 


+ Table D-4, “Managing a Cluster Resource or Resource Properties,” on page 490 
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Table D-1 describes how to select the cluster you want to manage. 


Table D-1 Selecting a Cluster to Manage 


Clusters Plug-In for iManager 2.7.4 and Earlier 


1. In Roles and Tasks, select Clusters, then select 
Cluster Manager, BCC Manager, Cluster Event 
Log, or Cluster Options. 


2. Specify the cluster name, or browse and select 
the Cluster object. 


You must repeat the selection process to 
manage a different cluster. There is no 
capability to concurrently view the status of 
multiple clusters. 


Clusters Plug-In for iManager 2.7.5 and Later 


1. In Roles and Tasks, select Clusters > My 
Clusters. 


The list is initially empty. 


2. On the My Clusters page, click Add to open the 
eDirectory browser pop-up window. 


3. Browse the tree where you are currently logged 
in to locate and select one or more clusters that 
you want to manage, then click OK. 


The selected clusters are added to the list. 


Your personalized list is displayed each time 
you log in to this iManager server and return to 
the My Clusters page. Use the Add and 
Remove options to modify your list as needed. 


4. Do any of the following from this page: 


+ Concurrently view the status of multiple 
clusters. 


+ Click the name link of a cluster to manage 
it. 


The Cluster Manager page opens. You can 
also select the other tabs from this page: 
BCC Manager, Cluster Event Log, or 
Cluster Options. 


+ Select the check box next to the cluster, 
then select Actions > Edit Properties to 
manage the cluster properties. 


+ Select the check box next to the cluster, 
then select Actions > Run Report. 


Table D-2 describes how to access the cluster management pages: Cluster Manager, BCC Manager, 
Cluster Event Log, and Cluster Options. The instructions for the Clusters plug-in for Novell iManager 
2.7.5 and later assume that you have created a personalized list of clusters, as described in Table D- 


1, 


Table D-2 Managing a Cluster 


Clusters Plug-In for iManager 2.7.4 and Earlier 


Cluster Manager 
1. In Roles and Tasks, select Clusters > Cluster 
Manager. 


2. Specify the cluster name, or browse and select 
the Cluster object. 


Clusters Plug-In for iManager 2.7.5 and Later 
Cluster Manager 


1. In Roles and Tasks, select Clusters > My 
Clusters. 
2. Click the name link of the cluster. 


3. Select the Cluster Manager tab. 
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Clusters Plug-In for iManager 2.7.4 and Earlier 


BCC Manager 
1. In Roles and Tasks, select Clusters > BCC 
Manager. 


2. Specify the cluster name, or browse and select 
the Cluster object. 


Cluster Event Log 
1. In Roles and Tasks, select Clusters > Cluster 
Event Log. 


2. Specify the cluster name, or browse and select 
the Cluster object. 


Clusters Plug-In for iManager 2.7.5 and Later 


BCC Manager 
1. In Roles and Tasks, select Clusters > My 
Clusters. 
2. Click the name link of the cluster. 


3. Select the BCC Manager tab. 
Cluster Event Log 


1. In Roles and Tasks, select Clusters > My 
Clusters. 
2. Click the name link of the cluster. 


3. Select the Cluster Event Log tab. 


Cluster Options 
1. In Roles and Tasks, select Clusters > Cluster 
Options. 


2. Specify the cluster name, or browse and select 
the Cluster object. 


Cluster Options 
1. In Roles and Tasks, select Clusters > My 
Clusters. 
2. Click the name link of the cluster. 


3. Select the Cluster Options tab. 


Table D-3 describes how to access the cluster properties pages: Policies, Priorities, Protocols, 
Resource Mutual Exclusion, and Business Continuity. The instructions for the Clusters plug-in for 
Novell iManager 2.7.5 and later assume that you have created a personalized list of clusters, as 


described in Table D-1. 


Table D-3 Accessing Cluster Properties 


Clusters Plug-In for iManager 2.7.4 and Earlier 


Clusters Plug-In for iManager 2.7.5 and Later 


From My Resources 
1. In Roles and Tasks, select Clusters > My 
Clusters. 


2. Select the check box next to the cluster, then 
click Actions > Edit Properties. 


From Cluster Options 
1. In Roles and Tasks, select Clusters > Cluster 
Options. 


2. Specify the cluster name, or browse and select 
the Cluster object. 


3. Click Properties. 


From Cluster Options 
1. In Roles and Tasks, select Clusters > My 
Clusters. 
2. Click the name link of the cluster. 
3. Select the Cluster Options tab. 
4. Click Properties. 
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Table D-4 describes how to view or manage cluster resources, including their properties: Policies, 
Monitoring, Preferred Nodes, Scripts (Load, Unload, and Monitor), and Business Continuity. 


Table D-4 Managing a Cluster Resource or Resource Properties 


Clusters Plug-In for iManager 2.7.4 and Earlier 


There is no capability to concurrently view the status 
of cluster resources across multiple clusters. 


Clusters Plug-In for iManager 2.7.5 and Later 


From My Resources: 


1. In Roles and Tasks, select Clusters > My 
Resources. 


The initial list is empty. 


2. On the My Resources page, click Add to open 
the eDirectory browser pop-up window. 


3. Browse the tree where you are currently logged 
in to locate and select the cluster resources that 
you want to manage for one or more clusters, 
then click OK. 


The selected cluster resources are added to the 
list. 


Your personalized list is displayed each time 
you log in to this iManager server and return to 
the My Resources page. Use the Add and 
Remove options to modify your list as needed. 


4. Do any of the following from this page: 


+ Concurrently view the status of multiple 
resources across multiple clusters. 


+ Click the name link of a resource to open 
its Resource Properties. 


+ Click the name link of the resource’s 
cluster to manage the cluster. 


From Cluster Manager: 


1. In Roles and Tasks, select Clusters > Cluster 
Manager. 


2. Specify the cluster name, or browse and select 
the Cluster object. 


3. Do any of the following: 


+ View the status of resources on this 
cluster. 


+ Click the name link of a resource to open 
its Resource Properties. 


+ Select the check box next to a resource, 
then click one of the following options: 


Online 

Offline 

Migrate 
Respond to Alert 


From Cluster Manager: 
1. In Roles and Tasks, select Clusters > My 
Clusters. 
2. Click the name link of the cluster. 
3. Select the Cluster Manager tab. 
Do any of the following: 


+ View the status of resources on this 
cluster. 


+ Click the name link of a resource to open 
its Resource Properties. 


+ Select the check box next to a resource, 
then click one of the following options: 


Online 

Offline 

Migrate 
Respond to Alert 
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From Cluster Options: 


1. 


In Roles and Tasks, select Clusters > Cluster 
Options. 


. Specify the cluster name, or browse and select 


the Cluster object. 


. Click the name link of a resource to open its 


Resource Properties. 


You can also select the check box next to the 
resource, then click the Details link. 


Clusters Plug-In for iManager 2.7.5 and Later 


From Cluster Options: 
1. In Roles and Tasks, select Clusters > My 
Clusters. 
2. Click the name link of the cluster. 


3. Select the Cluster Options tab. 


4. Click the name link of a cluster resource to open 


its Resource Properties. 


You can also select the check box next to the 
resource, then click the Details link. 
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= Documentation Updates 


E.1 


E.1.1 


E.2 


This section contains information about documentation content changes made to the Novell Cluster 
Services Administration Guide since the initial 2.0 release for Novell Open Enterprise Server 11. 


This document was updated on the following dates: 


¢ Section E.1, “July 2016 (OES 11 SP3),” on page 493 
¢ Section E.2, “January 2014 (OES 11 SP2),” on page 493 
¢ Section E.3, “August 2012 (OES 11 SP1),” on page 504 


July 2016 (OES 11 SP3) 


Updates were made to the following sections. The changes are explained below. 


What’s New or Changed in Novell Cluster Services 


Location Change 


Section 2.1, “What’s New (OES 11 SP3),” on page 29 This section is new. 


January 2014 (OES 11 SP2) 


Novell Business Continuity Clustering 2.0 for OES 11 SP1 was released in July 2013. For purchasing 
information, see the Novell Business Continuity Clustering product page (http://www.novell.com/ 
products/businesscontinuity/). 


Updates were made to the following sections. The changes are explained below. 


¢ Section E.2.1, “Clusters Plug-In Changes for Novell iManager 2.7.5,” on page 494 

¢ Section E.2.2, “Comparing Novell Cluster Services for Linux and NetWare,” on page 494 

¢ Section E.2.3, “Comparing Resources Support for Linux and NetWare,” on page 494 

¢ Section E.2.4, “Configuring and Managing Cluster Resources,” on page 494 

¢ Section E.2.5, “Configuring and Managing Cluster Resources for OES Services,” on page 496 


¢ Section E.2.6, “Configuring and Managing Cluster Resources for Shared LVM Volume Groups,” 
on page 496 


¢ Section E.2.7, “Configuring and Managing Cluster Resources for Shared NSS Pools and 
Volumes,” on page 497 


¢ Section E.2.8, “Configuring Cluster Policies, Protocols, and Properties,” on page 498 
¢ Section E.2.9, “Console Commands for Novell Cluster Services,” on page 500 
¢ Section E.2.10, “Installing, Configuring, and Repairing Novell Cluster Services,” on page 500 


¢ Section E.2.11, “Managing Clusters,” on page 500 
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¢ Section E.2.12, “Planning for Novell Cluster Services,” on page 501 


¢ Section E.2.13, “Security Considerations,” on page 502 


¢ Section E.2.14, “Troubleshooting Novell Cluster Services,” on page 502 

¢ Section E.2.15, “Upgrading Clusters from OES 2 SP3 to OES 11x,” on page 503 

¢ Section E.2.16, “Upgrading OES 11 Clusters,” on page 503 

¢ Section E.2.17, “What’s New or Changed in Novell Cluster Services,” on page 504 


Clusters Plug-In Changes for Novell iManager 2.7.5 


The Appendix D, “Clusters Plug-In Changes for Novell iManager 2.7.5,” on page 487 section is new. 
It describes the changes to the Clusters plug-in for Novell iManager 2.7.5, and compares how to 
perform common tasks in the old and new versions of the plug-in. 


Comparing Novell Cluster Services for Linux and NetWare 


This information was relocated to the OES 11 SP3: Novell Cluster Services NetWare to Linux 


Conversion Guide. 


Comparing Resources Support for Linux and NetWare 


This information was relocated to the OES 11 SP3: Novell Cluster Services NetWare to Linux 


Conversion Guide. 


Configuring and Managing Cluster Resources 


Location 


Section 10.2, “Setting Up a Personalized List of 
Resources to Manage,” on page 195 


Change 


Your personalized My Resources list and display 
settings are saved on the iManager server. 


Section 10.2.3, “Personalizing the My Resources 
Display,” on page 198 


If scrolling is needed to view the complete list, you can 
use the Refresh option to set a longer refresh rate for 
the page in order to allow enough time to view the 
status for all items. 


Section 10.2.5, “Updating the My Resources List after 
Renaming or Deleting a Resource,” on page 200 


This section is new. 


Section 10.7.3, “Monitoring Services that Are Critical 
to a Resource,” on page 212 


Section 10.7.4, “Example Monitor Scripts,” on 
page 213 


Beginning in OES 11 SP2, NCS provides the ability to 
monitor the status of the eDirectory daemon (ndsd) at 
the NCS level. It is disabled by default. The monitoring 
can be set independently on each node. It runs 
whenever NCS is running on the node. See 

Section 8.8, “Configuring NCS to Monitor the 
eDirectory Daemon (ndsd),” on page 132. 


Added links to sample monitor scripts for clustered 
LVM volume groups that were created in NSSMU or 
NLVM. 
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Location 


Section 10.5, “Configuring a Load Script for a Cluster 
Resource,” on page 206 


Section 10.6, “Configuring an Unload Script for a 
Cluster Resource,” on page 207 


Section 10.7, “Enabling Monitoring and Configuring 
the Monitor Script,” on page 208 


Change 


Apply the updated scripts by taking the resource offline 
and then bringing it online on the same node. 
Alternatively, after the updated scripts have been 
synchronized from eDirectory to the source and 
destination nodes, the updated scripts are used 
automatically on system failover or cluster migration. 
For more information, see Section 10.8, “Applying 
Updated Resource Scripts by Offline/Offline, Failover, 
and Migration,” on page 213. 


Section 10.8, “Applying Updated Resource Scripts by 
Offline/Offline, Failover, and Migration,” on page 213 


This section is new. 


Section 10.1.2, “Using Parameter Values with Spaces 
in a Cluster Script,” on page 194 


Section 10.1.3, “Using Double Quotation Marks in a 
Cluster Script,” on page 194 


Section 10.10, “Configuring Preferred Nodes and 
Node Failover Order for a Resource,” on page 216 


In cluster scripts, if a parameter value contains spaces, 
you must enclose the value with both double-quotes 
(") and a single-quotes ('). For example, "' quoted 
text’. 


This section is new. 


When you change the failover order of nodes ina 
resource’s Preferred Nodes list, the change takes 
effect immediately when you click OK or Apply if the 
resource is running. Otherwise, it takes effect the next 
time the resource is brought online. 


IMPORTANT: Ensure that you prepare the node for 
the services in the resource before you migrate or fail 
over the resource to it. 


Step 8 in Section 10.10, “Configuring Preferred Nodes 
and Node Failover Order for a Resource,” on page 216 


If you remove nodes from the Assigned list in the Edit 
view, the removed nodes are automatically added to 
the Unassigned list when you save. 


The sections noted were moved from this chapter to 
Chapter 8, “ Configuring Cluster Policies, Protocols, 
and Properties,” on page 113 


Section 8.7, “Configuring Cascade Failover 
Prevention,” on page 129 


Section 8.9, “Configuring the Cluster Node Reboot 
Behavior,” on page 135 


Section 8.10, “Configuring STONITH,” on page 136 


Section 8.11, “Viewing or Modifying the NCS Proxy 
User Assignment in the NCS Management Group,” on 
page 138 


Section 8.13, “Moving a Cluster, or Changing the Node 
IP Addresses, LDAP Servers, or Administrator 
Credentials for a Cluster,” on page 143 


Section 10.16, “Deleting Cluster Resources, or 
Disabling Clustering for a Pool, LVM Volume Group, or 
Service,” on page 228 


This section was revised for clarity. 


NSS tools have been modified so that it is not 
necessary to stop NCS in order to disable the 
Shareable for Clustering setting. The device should 
not contain partitions that are used by shared pools, 
clustered pools, or SBDs. 
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E.2.5 Configuring and Managing Cluster Resources for OES 


Services 

Location Change 

Table 11-2, “Clustering Storage with Novell Cluster This table provides links to information about creating 
Services,” on page 234 resources for different file system solutions. 

Table 11-3, “Clustering Linux Services with Novell This table provides links to information about creating 
Cluster Services,” on page 235 resources for some Linux services. 


E.2.6 Configuring and Managing Cluster Resources for Shared 
LVM Volume Groups 


Location Change 

Section 13.3, “Configuring an LVM Volume Group If you enable NCP for the volume, this name must 
Cluster Resource with NSS Management Tools,” on comply with the “Naming Conventions for NCP 
page 334 Volumes” on page 329. Lowercase letters are 


automatically changed to uppercase for the NCP 
volume name. 


Section 13.3, “Configuring an LVM Volume Group Ensure that you log in to the master node to create 
Cluster Resource with NSS Management Tools,” on clustered LVM volume groups with NSSMU and NLVM 
page 334 commands. 


Typically, the volume creation takes less than 10 
seconds. However, if you have a large tree or if the 
server does not hold an eDirectory replica, the create 
time can take up to 3 minutes. 


When an LVM logical volume group is clustered, CLVM 
manages the share state, not the device. NSSMU 
reports the device as Not Shareable for Clustering. 
NSSMU reports the clustered volume is Shareable for 
Clustering. 


Section 13.4.2, “Creating a Generic File System Ensure that the SAN device is attached to all of the 
Cluster Resource for an LVM Volume Group,” on nodes in the cluster. 


page 358 m 
Ensure that the existing LVM volume you want to 


cluster-enable is deactive on all nodes in the cluster. 
Be mindful that Linux path names are case sensitive. 
The mount path must already exist. 


If the resource goes comatose, typical issues are that 
the target LVM volume is still active locally on a node, 
the path names were not entered as case sensitive, 
the IP address is not unique in the network, or the 
mount path does not exist. 


Section 13.11, “Deleting a Clustered LVM Volume This section is new. 
Group and Logical Volume,” on page 390 
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E.2.7 


Configuring and Managing Cluster Resources for Shared 


NSS Pools and Volumes 


Location 


Chapter 12, “Configuring and Managing Cluster 
Resources for Shared NSS Pools and Volumes,” on 
page 237 


“Location of Cluster, Server, and Storage Objects” on 
page 240 


“Extending the Size of a LUN” on page 306 


“Creating and Sharing a New LUN Device” on 
page 311 


Change 


All sample load scripts and unload scripts for NSS pool 
cluster resources were updated to reflect the new 
default sequence of commands for OES 11 SP1. 
Newly created pool cluster resources use the following 
sequence for commands in a load script. The order is 
reversed in an unload script. 


NSS 

[NFS] (If NFS is used, you manually add the command 
here.) 

Secondary IP address 

NCP 

[AFP] 

[CIFS] 


If the objects are in different contexts, you might need 
to cluster migrate the pool cluster resource back to the 
context where the pool was created in order to modify 
the pool or volume, or to perform other tasks like 
setting up Distributed File Services junctions or home 
directories. You receive an eDirectory error if the 
operation cannot find the information that it needs in 
the same context. 


WARNING: In EMC PowerPath environments, do not 
use the rescan-scsi-bus. sh utility provided with the 
Operating system or the HBA vendor scripts for 
scanning the SCSI buses. To avoid potential file 
system corruption, EMC requires that you follow the 
procedure provided in the vendor documentation for 
EMC PowerPath for Linux. 


Section 12.4.1, “Creating a Cluster-Enabled Pool and 
Volume with iManager,” on page 247 


Section 12.4.2, “Creating a Cluster-Enabled Pool and 
Volume with NSSMU,” on page 250 


Ensure that the SAN device is attached to all of the 
nodes in the cluster. 


Ensure that you log in to the master node to create 
clustered pools and volumes. 


Typically, the pool creation takes less than a minute. 
The volume creation takes less than 10 seconds. 
However, if you have a large tree or if the server does 
not hold an eDirectory replica, the create time can take 
up to 3 minutes. 


Section 12.6.3, “Specifying Custom Mount Options,” 
on page 261 


Inthe ncpcon mount command, place the /opt switch 
before the volume information. 


ncpcon mount /opt=ns=long 
<VOLUMENAME >=<VOLUMEID> 
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Location 


Section 12.10, “Adding NFS Export for a Clustered 
Pool Resource,” on page 266 


Change 


Before you use the exportfs (8) command in 
resource scripts, ensure that you install the nfs- 
kernel-server package on all of the cluster nodes in 
the resource’s preferred nodes list. This contains the 
support utilities for the kernel nfsd daemon. It is not 
installed by default. You can use the YaST > Software 
> Software Management tool to find and install the 
package. 


Section 12.10.1, “Sample NFS Load Script,” on 
page 267 


Add the following command in the load script before 
the exportfs command: 


# Start the NFS service 
exit_on_error renfsserver start 


Section 12.12, “Renaming a Clustered NSS Pool,” on 
page 271 


This section was updated for clarity. 


Section 12.12.3, “Renaming a Shared Pool and Its 
Resource Objects,” on page 277 


This section is new. 


Section 12.12.4, “Renaming a Shared Pool in a DST 
Cluster Resource,” on page 281 


This section is new. 


Section 12.13, “Renaming a Clustered NSS Volume,” 
on page 283 


This section is new. 


Section 12.14, “Renaming the Mount Point Path for a 
Shared NSS Volume (Using a Custom Mount Point for 
a Shared NSS Volume),” on page 296 


This section is new. 


Section 12.20, “Disabling Clustering for a Pool,” on 
page 316 


This section is new. 


Section 12.21, “Deleting and Re-Creating a Pool 
Cluster Resource (Disabling and Re-Enabling 
Clustering for a Pool),” on page 318 


Section 12.22, “Deleting a Clustered Pool,” on 
page 322 


Configuring Cluster Policies, 


Location 


Section 8.1.5, “BCC,” on page 116 


Section 8.1.7, “Monitoring the eDirectory Daemon,” on 
page 116 


Section 8.2, “Setting Up a Personalized List of 
Clusters to Manage,” on page 117 


This section is new. 


This section was updated for clarity and moved to the 
NSS chapter. 


NSS tools have been modified so that it is not 
necessary to stop NCS in order to disable the 
Shareable for Clustering setting. The device should 
not contain partitions that are used by shared pools, 
clustered pools, or SBDs. 


Protocols, and Properties 


Change 


This section is new. 


This section is new. 


Your personalized My Clusters list and display settings 
are saved on the iManager server. 
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Location 


Section 8.2.3, “Personalizing the My Clusters Display,” 
on page 119 


Change 


If scrolling is needed to view the complete list, you can 
use the Refresh option to set a longer refresh rate for 
the page in order to allow enough time to view the 
status for all items. 


Section 8.3, “Selecting a Cluster to Manage,” on 
page 121 


If the master IP address is having a problem, the My 
Clusters page of the Clusters plug-in allows you to use 
the IP address of a specified node (preferably the 
master node) to manage the cluster. 


Section 8.7, “Configuring Cascade Failover 
Prevention,” on page 129 


Cascade failover prevention is supported in OES 2 
SP3 and later. 


You can create a configuration file in the /etc/ 
modprobe . d file that contains the flag setting to enable 
and disable the Cascade Failover Prevention function 
for the server. 


Section 8.7.1, “Understanding the Cascade Failover 
Prevention Quarantine,” on page 129 


A resource might be quarantined if it is likely 
responsible for several consecutive server failures, 
unrelated to interference from failures of other 
resources. 


Section 8.8, “Configuring NCS to Monitor the 
eDirectory Daemon (ndsd),” on page 132 


This section is new. 


Section 8.12, “Viewing or Modifying the Cluster Master 
IP Address or Port,” on page 139 


If the master IP address is having a problem, the My 
Clusters page of the Clusters plug-in allows you to use 
the IP address of a specified node (preferably the 
master node) to manage the cluster while you fix the 
master IP address. 


Section 8.12, “Viewing or Modifying the Cluster Master 
IP Address or Port,” on page 139 


A cluster restart is required before iManager can 
continue to manage the cluster with its new master IP 
address. 


Section 8.13, “Moving a Cluster, or Changing the Node 
IP Addresses, LDAP Servers, or Administrator 
Credentials for a Cluster,” on page 143 


This section was relocated here from the “Managing a 
Cluster” section. 


“Changing the IP Addresses of Cluster Resources” on 
page 145 


This section was modified to also address Linux 
volume cluster resources. 


“Changing the IP Address of the Master IP Resource” 
on page 147 


This section is new. 
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Console Commands for Novell Cluster Services 


Location 


SCAN FOR NEW DEVICES in Table A-1, “Cluster 
Console Commands,” on page 450 


Change 


You can use the Linux rescan-scsi-bus.sh utility to 
scan for new devices. 


WARNING: In EMC PowerPath environments, do not 
use the rescan-scsi-bus.sh utility provided with the 
Operating system or the HBA vendor scripts for 
scanning the SCSI buses. To avoid potential file 
system corruption, EMC requires that you follow the 
procedure provided in the vendor documentation for 
EMC PowerPath for Linux. 


Section A.5, “DotOutParser Utility,” on page 459 


Section A.8, “ncs_install.py Script (Extending the 
Schema, Monitoring NDSD, or Removing NCS 
Configuration),” on page 468 


This section is new. 


This section is new. 


Section A.10, “ncs_resource_scripts.pl Script 
(Modifying Resource Scripts Outside of iManager),” on 
page 474 


This section is new. 


Installing, Configuring, and Repairing Novell Cluster 


Services 


Location 


Section 5.7.2, “Installing the Clusters Plug-In,” on 
page 93 


Step 5 in Section 5.7.3, “Uninstalling and Reinstalling 
the Clusters Plug-In,” on page 94 


Change 


Verify that the /var/opt/novell/iManager/nps/ 

WEB -INF/1ib directory contains the class loader file 
commons-lang-2.6.jar (or later version), then 
remove all earlier versions of the file. You must remove 
the earlier versions (Such as commons-lang.jar or 
commons-lang-2.4.jar) to ensure that iManager 
loads the 2.6 or later version of the class loader file. 


Section 5.9, “Removing the NCS Configuration 
Information from a Node,” on page 95 


Managing Clusters 


Location 


Section 9.1.2, “Stopping Novell Cluster Services,” on 
page 152 


This section is new. 


Change 


Novell Cluster Services is a kernel-space application. 
As with any kernel-space application, unloading it is a 
best effort and is not guaranteed to stop the modules. 
If Novell Cluster Services is busy providing services 
from the kernel when you attempt to stop it, the 
process might not stop, and a reboot might be 
required. 
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Location 


Section 9.3, “Selecting a Cluster to Manage,” on 
page 154 


Change 


If the master IP address is having a problem, the My 
Clusters page of the Clusters plug-in allows you to use 
the IP address of a specified node (preferably the 
master node) to manage the cluster. 


Section 9.4, “Monitoring Cluster and Resource States,” 
on page 157 


If scrolling is needed to view the complete list, you can 
use the Refresh option to set a longer refresh rate for 
the page in order to allow enough time to view the 
status for all items. 


Section 9.6, “Viewing the Cluster Event Log in 
iManager,” on page 161 


This section is new. 


The Time Interval replaces the Start Date and Time 
field on the Event Log Filter page. 


Section 9.7, “Viewing the Cluster Event Log at the 
Command Line,” on page 163 


Section 9.8, “Viewing Summaries of Failed or 
Incomplete Events from the *.out Log Files,” on 
page 164 


This section is new. 


This section is new. 


Section 9.14, “Joining a Node to the Cluster (Rejoining 
a Cluster),” on page 171 


While the node is not active in the cluster, any changes 
in storage objects (Such as creating, deleting, or 
expanding clustered pools) are not updated 
automatically for the node. After you rejoin the node to 
the cluster, use the nlvm rescan command to 
recognize the storage changes. 


Planning for Novell Cluster Services 


Location 


Section 4.4, “Hardware Requirements,” on page 51 


Change 


In addition to Ethernet NICs, Novell Cluster Services 
supports VLAN on NIC bonding in OES 11 SP2 and 
later. No modifications to scripts are required. You can 
use ethx or vlanx interfaces in any combination for 
nodes in a cluster. 


Section 4.6.4, “SLP,” on page 56 


The SLP refresh interval is now based on the 
eDirectory advertise-life-time setting. 


Section 4.6.6, “Clusters Plug-in for iManager,” on 
page 58 


Novell Business Continuity Clustering 2.0 for OES 11 
SP1 is supported in the Clusters plug-in for OES 11 
SP1 with the latest patches applied. 


See the BCC 2.0: Administration Guide for OES 11 
SP1 (http://www.novell.com/documentation/bcc/ 
bcec20_admin_Ix/data/bookinfo.html). 


Section 4.8.1, “Shared Devices,” on page 65 


All devices that contribute space to a clustered pool 
must be able to fail over with the pool cluster resource. 
You must use the device exclusively for the clustered 
pool; do not use space on it for other pools or for Linux 
volumes. A device must be marked as Shareable for 
Clustering before you can use it to create or expand a 
clustered pool. 
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Location 


Section 4.8.2, “SBD Partitions,” on page 65 


Change 


NLVM and other NSS management tools need the 
SBD to detect if a node is a member of the cluster and 
to get exclusive locks on physically shared storage. 


Because an SBD partition ends on a cylinder 
boundary, the partition size might be slightly smaller 
than the size you specify. When you use an entire 
device for the SBD partition, you can use the ‘max’ 
option as the size, and let the software determine the 
size of the partition. 


Section 4.8.4, “Shared RAID Devices,” on page 67 


Security Considerations 


Location 


Section 17.4, “Log Files,” on page 448 


Any NSS software RAIDO/5 device that is used for a 
clustered pool must contribute space exclusively to 
that pool; it cannot be used for other pools. This allows 
the device to fail over between nodes with the pool 
cluster resource. Ensure that its component devices 
are marked as Shareable for Clustering before you 
use a RAIDO/5 device to create or expand a clustered 
pool 


Change 


Added links to procedures to view the Event Log. 


Added information about the DotOutParser utility. 


Troubleshooting Novell Cluster Services 


Location 


“Cannot Find the Prevent Cascading Failover Option” 


Change 


This section is was removed. Cascading failover is 
supported in OES 11 and later. See Section 8.7, 
“Configuring Cascade Failover Prevention,” on 
page 129. 


“NSS Takes Up to 10 Minutes to Load When the 
Server Is Rebooted (Linux)” 


This section was removed. It is not an issue in OES 11 
and later. 


Section 16.6, “Master IP Address Problem,” on 
page 440 


This section is new. 


Section 16.9, “iManager: Error 500 Occurs after 
Installing or Updating the Clusters Plug-In for Novell 
iManager 2.7.5,” on page 441 


This section is new. 


Section 16.10, “iManager: Problems with Clusters 
Plug-In After Update for Novell iManager 2.7.5,” on 
page 441 


Section 16.18, “Error NFS Stale Handle Reported on 
Host when Cluster Failover Occurs,” on page 443 


This section is new. 


This section is new. 


OES 11 SP3: Novell Cluster Services for Linux Administration Guide 


E.2.15 


E.2.16 


Location 


Section 16.19, “Error 20897 - This node is not a cluster 


member,” on page 443 


Change 


This section is new. 


Section 16.22, “Migration Authentication Error Occurs 
when Connecting to a New Cluster Resource on the 
Target Server,” on page 444 


This section is new. 


Upgrading Clusters from OES 2 SP3 to OES 11x 


Location 


Chapter 7, “Upgrading Clusters from OES 2 SP3 to 
OES 11 SPx,” on page 105 


Change 


IMPORTANT: You can upgrade a cluster from OES 2 
SP3 to OES 11 or from OES 2 SP3 to OES 11 SP1. 
The same release version of OES 11 must be installed 
and running on each new or upgraded node in the 
cluster. 


The procedures in this section refer to OES 11x. A 
specific version of OES 11 is mentioned only if the 
procedure applies only to that version of the platform. 


Section 7.4, “Adding OES 11x Nodes to an OES 2 SP3 
Cluster (Rolling Cluster Upgrade),” on page 109 


During a rolling cluster upgrade, one OES 11x server 
is added at a time, either by adding a new node or 
upgrading an OES 2 SP3 node: 


+ Add an OES 11x node and migrate resources to 
it. 


+ Remove (cluster leave command) an OES 2 SP3 
node, upgrade it to OES 11x, return it to the 
cluster, and migrate resources to it. 


Section 7.6, “Upgrading a Cluster with DST Resources 
from OES 2 SP3 to OES 11x,” on page 112 


Upgrading OES 11 Clusters 


Location 


Section 6.2, “Upgrading Nodes in the Cluster (Rolling 
Cluster Upgrade),” on page 101 


If you replace an OES 2 SP3 node with an OES 11x 
node instead of using an in-place upgrade to OES 11x, 
you must manually configure the global policies and 
move the All Shadowed Volumes policies data to the 
OES 11x node. 


Change 


If autostart is configured for the node, to prevent NCS 
from automatically loading during upgrade, you need 
to run "chkconfig -s novell-ncs off" after NCS 
has been stopped (before the upgrade), and 
"chkconfig -s novell-ncs on" after NCS has been 
started (after the upgrade). 
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E.2.17 


E.3 


Location Change 


Section 6.3, “Upgrade Issues for OES 11 SP1,” on This section is new. 


page 104 : . . 
The Section 6.3.1, “Updating the Clusters Plug-in and 


Role-Based Services in iManager,” on page 104 was 
moved to this section. 


Section 6.3.2, “DHCP Cluster Resource: Path Change This issue is new. 
for dhcpd.pid,” on page 104 


What’s New or Changed in Novell Cluster Services 


Location Change 


“What’s New (OES 11 SP2)” on page 29 This section is new. 


August 2012 (OES 11 SP1) 


Procedures throughout the guide were updated to use the newly reorganized Clusters plug-in for 
iManager. In addition, updates were made to the following sections. The changes are explained 
below. 

¢ Section E.3.1, “Console Commands for Novell Cluster Services,” on page 505 

¢ Section E.3.2, “Comparing Novell Cluster Services for Linux and NetWare,” on page 505 

¢ Section E.3.3, “Configuring and Managing Cluster Resources,” on page 505 


¢ Section E.3.4, “Configuring and Managing Cluster Resources for Shared Linux LVM Volume 
Groups,” on page 505 


¢ Section E.3.5, “Configuring and Managing Cluster Resources for Shared NSS Pools and 
Volumes,” on page 506 


¢ Section E.3.6, “Configuring Cluster Policies, Protocols, and Priorities,” on page 507 


¢ Section E.3.7, “Configuring Novell Cluster Services in a Virtualization Environment,” on 
page 507 


¢ Section E.3.8, “Electing a Master Node,” on page 507 

¢ Section E.3.9, “Files for Novell Cluster Services,” on page 507 

¢ Section E.3.10, “Installing and Configuring Novell Cluster Services on OES 11,” on page 508 
¢ Section E.3.11, “Managing Clusters,” on page 508 

¢ Section E.3.12, “Planning for Novell Cluster Services,” on page 508 

¢ Section E.3.13, “Security Considerations,” on page 508 

¢ Section E.3.14, “Troubleshooting Novell Cluster Services,” on page 509 


¢ Section E.3.15, “Upgrading and Managing Cluster Resources for Linux POSIX Volumes with 
CSM Containers,” on page 509 


¢ Section E.3.16, “Upgrading Clusters from OES 2 SP3 to OES 11 SP1,” on page 509 
¢ Section E.3.17, “Upgrading OES 11 Clusters,” on page 509 
¢ Section E.3.18, “What's New or Changed in Novell Cluster Services,” on page 509 
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E.3.1 


E.3.2 


E.3.3 


E.3.4 


Console Commands for Novell Cluster Services 


Location 


“NCPCON Mount Command for NCP and NSS 
Volumes” on page 476 


Change 


This section is new. 


Comparing Novell Cluster Services for Linux and NetWare 


Updated for new or changed OES 11 SP1 features. 


Configuring and Managing Cluster Resources 


Location 


Section 10.1.2, “Using Parameter Values with Spaces 
in a Cluster Script,” on page 194 


Change 


This section is new. 


Section 10.2, “Setting Up a Personalized List of 
Resources to Manage,” on page 195 


This section is new. 


Section 10.14, “Changing the IP Address of a Cluster 
Resource,” on page 224 


This procedures in this section are new. 


Configuring and Managing Cluster Resources for Shared 


Linux LVM Volume Groups 


Location 


“NCP File Access with Novell NCP Server” on 
page 329 


Change 


For information about using antivirus software with 
NCP volumes, see “Security” in the OES 11 SP3: 
Planning and Implementation Guide. 


Section 13.3, “Configuring an LVM Volume Group 
Cluster Resource with NSS Management Tools,” on 
page 334 


This section was expanded to include nlvm commands 
and NCP enabling the clustered LVM logical volume. 


Section 13.6, “Enabling NCP File Access for a 
Clustered LVM Volume,” on page 373 


This section is new. 


Section 13.7, “Modifying the LVM Resource Scripts for 
Other Services,” on page 380 


This section is new. 
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Configuring and Managing Cluster Resources for Shared 


NSS Pools and Volumes 


Location 


“Volume” on page 239 


Change 


For information about using antivirus software with 
NSS volumes, see “Antivirus Support for NSS” in the 
OES 11 SP3: NSS File System Administration Guide 
for Linux and “Security” in the OES 11 SP3: Planning 
and Implementation Guide. 


“NCP Server for Linux” on page 240 


NCP Server does not support cross-protocol locks 
across a cluster migration or failover of the resource. 


Hyphens are used in the default NCP virtual server 
name. Underscores can be used in custom names. 


“Novell CIFS for Linux” on page 241 


The default name suggested for the CIFS virtual 
server name is based on the NCP virtual server name. 


“Initializing and Sharing a Device with NLVM” on 
page 246 


This section is new. 


“Cluster-Enabling an Existing NSS Pool and Its 
Volumes” on page 253 


The default name suggested for the CIFS virtual 
server name is based on the NCP virtual server name. 


“Specifying a Custom Mount Point for an NSS Volume” 
on page 261 


For information about using a custom mount point 
path, see Section 12.14, “Renaming the Mount Point 
Path for a Shared NSS Volume (Using a Custom 
Mount Point for a Shared NSS Volume),” on page 296. 


“Configuring a Monitor Script for the Shared NSS Pool” 
on page 264 


If AFP is used as an advertising protocol, the 
exit_on_error afpstat command is added to the 
monitor script. 


“Adding NFS Export for a Clustered Pool Resource” on 
page 266 


This section is new. 


“Renaming a Clustered NSS Pool” on page 271 


Because renaming involves changing information for 
the Pool object in eDirectory, you must ensure that the 
shared pool is active on a cluster node that has its 
NCP server object in the same context as the Pool 
object of the pool you are going to rename. 


Added details for the renaming procedure. 


“Changing the Name Space for a Clustered NSS 
Volume” on page 302 


This section is new 


“Expanding the Size of a Clustered Pool” on page 304 


Corrected the procedures for an online pool 
expansion. 
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E.3.6 


E.3.7 


E.3.8 


E.3.9 


Configuring Cluster Policies, 


Location 


Section 8.5, “Configuring Cluster Protocols,” on 
page 125 


Protocols, and Priorities 


Change 


Modify the Master Watchdog and Slave Watchdog 
parameter settings only when supervised by Novell 
Technical Support (http://www.novell.com/support). 


Section 8.6, “Configuring Cluster Event Email 
Notification,” on page 127 


Because both Postfix and the GWIA default to using 
port 25, you must configure the GWIA to bind 
exclusively to its resource’s secondary IP address in 
order to avoid a port conflict between Postfix and the 
GWIA. 


Section 8.12, “Viewing or Modifying the Cluster Master 
IP Address or Port,” on page 139 


A cluster restart is required before iManager can 
continue to manage the cluster. 


Configuring Novell Cluster Services in a Virtualization 


Environment 


Location 


Chapter 15, “Configuring Novell Cluster Services in a 
Virtualization Environment,” on page 421 


Electing a Master Node 


Change 


To get started with KVM virtualization, see the 
Virtualization with KVM documentation (http:// 
www.suse.com/documentation/sles11/book_kvm/data/ 
book_kvm.html). 


The section Appendix C, “Electing a Master Node,” on page 483 is new. 


Files for Novell Cluster Services 


Location 


Table B-1, “Location and Purpose of Novell Cluster 
Services Files,” on page 479 


Change 


References to the hang-check timer were removed. It 
was obsoleted in OES 2 SP2 Patches. 


The NCS tolerance is now used to determine whether 
NCS has been starved of CPU. You can use directive 
kernel.panic in file /etc/sysct1.conf file to control 
the behaviors after NCS has determined to kill the 
node. See Section 8.1.8, “Cluster Node Reboot 
Behavior,” on page 116. 


“/opt/novell/ncs/bin/NCS_STONITH_SCRIPT file” on 
page 480 


You create and code the /opt /novell/ncs/bin/ 
NCS_STONITH_ SCRIPT script file to enable and control 
the STONITH feature. 
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E.3.10 


E.3.11 


E.3.12 


E.3.13 
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Installing and Configuring Novell Cluster Services on OES 


11 


Location 


Section 5.7, “Installing or Updating the Clusters Plug- 
in for iManager,” on page 93 


Managing Clusters 


Location 

Section 9.4, “Monitoring Cluster and Resource States,” 
on page 157 

Section 9.5, “Responding to a Start, Failover, or 
Failback Alert,” on page 159 


Table 9-2, “Cluster Resource States,” on page 158 


Change 


Expanded to explain the updates for OES 11 SP1. 


Change 


Added information about the Resource not found 
condition for resources on the My Resources page of 
the Clusters plug-in. 


This section is new. 


Updated the Alert entry to identify alert types: Start 
alert, Failover alert, and Failback alert. 


Section 8.10, “Configuring STONITH,” on page 136 


This section is new. 


Planning for Novell Cluster Services 


Location 


Section 4.3, “Volume ID Requirements,” on page 50 


Change 


Volume IDs for BCC-enabled clustered volumes must 
be unique across all nodes in every peer cluster. 


“NCP Server for Linux” on page 61 


NCP Server does not support cross-protocol locks 
across a cluster migration or failover of the resource. 


Section 4.10.3, “Modifying the Polling Interval, No Path 
Retry, and Failback Settings in the multipath.conf File,” 
on page 69 


Added information about the polling_interval. 


Section 4.6.8, “SFCB and CIMOM,” on page 59 


Security Considerations 


Location 


“Ports” on page 447 


The user name that you use to log in to Novell 
iManager when you manage a cluster and the BCC 
cluster must be an eDirectory user name that has 
been LUM-enabled. 


Change 


Email Notification uses Postfix, port 25. 
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Location Change 


“Log Files” on page 448 NCS configuration writes log messages to /var/log/ 


YaST2/y21log. 
“Configuration Files” on page 448 This section is new. 


E.3.14 Troubleshooting Novell Cluster Services 


Location Change 


“iManager: Error 500 Occurs while Connecting to a This section is new. 
Cluster” on page 440 


E.3.15 Upgrading and Managing Cluster Resources for Linux 
POSIX Volumes with CSM Containers 


Location Change 


“Configuring and Adding OES 11x Nodes to the OES 2 The path for the NLVM configuration file is /etc/opt/ 
SP3 Cluster” on page 415 novell/nss/nlvm.conf. 


E.3.16 Upgrading Clusters from OES 2 SP3 to OES 11 SP1 


Location Change 


“Supported Upgrade Paths from OES 2 SP3 to OES Upgrade is supported from OES 2 SP3 on SLES 10 
11x” on page 107 SP3 or SLES 11 SP4 to OES 11 SP1 on SLES 11 SP2. 


Section 7.3, “Requirements and Guidelines for Upgrade OES 2 SP3 cluster nodes with the higher IP 
Upgrading Clusters from OES 2 SP3,” on page 108 addresses first. 


Multiple locations Procedures have been updated for OES 11 SP1. 


E.3.17 Upgrading OES 11 Clusters 


This section is new. 


E.3.18 What’s New or Changed in Novell Cluster Services 


Location Change 


“What's New (OES 11 SP1)” on page 34 This section is new. 
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